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ABSTRACT 

Title VII federal funds have been used in the Austin 
(Texas) Independent School District (AISD) to help limited English 
proficient (LEP) students. In 1986-87, 4,143 students were assisted, 
87% of whom were Spani. h speakers. LE'^ students in the AISD are 
helped through Transitional Bilingual Education (TBE) and English as 
a Second Language (ESL) instruction. TBE is available to 
pre-kindergarten through grade 8. The regular secondary program is 
also enhanced for Hispanic LEP students. Pre- and posttest data were 
analyzed for four tests (including the Language Assessment Battery) 
by grade and test area. In 1986-87, English proficiency improved 
significantly at four of six tested grade levels, with 78% of 
individual students scoring gains. English achievement levels 
generally improved. Spanish proficiency and achievement results were 
generally positive. A total of 120 students received tutoring through 
Title VII in 1986-87, compared to 76 the previous school year. Parent 
workshops provided in 1986-87 (n=18) received uniformly positive 
ratings and conunents. The bulk of the report consists of 10 
appendixes giving facts and figures on test results, teacher and 
administrator survey results, tutor records, parent workshops, 
district records, and dropouts. (SLD) 
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The Austin Independent School District (AISD) served 4,143 students with 
limited English proficiency (LEP) in 1986-87; 875^ were Spanish speakers, 5% 
were Vietnamese, and 8% represented 49 other language groups. LEP students in 
AISD are served through one of two basic programs— Transitional Bilingual 
Education (TBE) and English as a Second Language (ESL). TBE, which provides 
dual language instruction, is available to Spanish speakers at grades pre-K 
through 8 and Vietnamese speakers at grades K-6. ESL provides intensive 
English instruction to other LEP students. Only those who decline service Dy 
these programs are not served. 

Title VII federal funds have been utilized in AISD since 1985-86 to enhance 
the regular secondary program for Hispanic LEP students. The four secondary 
campuses involved are those with the highest concentrations of Hispanic LEP 
students— Murchi son Junior High plus Travis » Anderson, and Johnston High 
Schools. The overall budget of the 1986-87 Title VII Program was $87,893; 
274 students were impacted (for a cost of $321 per student). Title VII 
provided four additional types of service: * 

e Staff training (through ESL endorsement courses and campus workshops), 

§ Student tutoring, 

9 Curriculum development, and 

• Parent training. 



MAJOR FINDINGS: TITLE VII 



1. English proficiency improved significantly at four of six grade levels 
from fall to spring (based on raw scores on the Language Assessment 
Battery). Most individual students (78%) made gains. 

2. English achievement improved in each of five subject areas at most 
grade levels based on the ITBS and TAP; 1S87 percentile scores were 
higher than 1986 scores in 17 of 23 comparisons. 
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3. Spanish prpficiency^and acnievement results on La Prueba Riverside de 
Realizacion en Espam)! (Prueba Riverside) were generally positive. 
The percent of students overall showing gains in langua^a and content 
areas increased over 1985-86; thus, objectives were met. Additionally, 
when mean raw score gains were examined by subject and grade, 16 out of 
20 comparisons were significant. 

4. The number of LEP students tutored through Title VII increased from 76 
in 1985-86 to 120 in 1986-87. 

5. Four courses leading to endorsement to teach ESL were offered through 
Title VII; three teachers completed all courses. 

6. A total of 18 parent workshops were provided in 1986-87. Evaluation 
ratings and cominents were uniformly positive. 
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TITLE VII PROGRAM DESCRIPTION 



Title VII federal funds have been utilized in AISD since 1985-86 to enhance 
the regular secondary p.jgram for Hispanic LEP students. Title VII provides 
four additional types of service— 

0 Staff training (through ESL endorsement courses and campus workshops), 

• Student tutoring, 

0 Curriculum development, and 

c Parent training. 

The four secondary campuses involved are those with the highest concentra- 
tions of Hispanic LEP students— Murchison Junior High plus Travis, Andersc , 
and Johnston High Schools. A total of 307 LEP students monolingual or 
dominant in Spanish or balanced in English and Spanisn (LEP categories A, B, 
or C) were enrolled in these schools for part or all of 1986-87 and were 
therefore impacted by Title VII services; 253 LEP students were enrolled at 
these schools at year's end. 

AISD-funded services at the campuses are shown Delow. 
AISD-Funded Services Title VII Campuses 



Murchison 



Travis 



Anderson 



Johnston 



Bilingual content area 
instruction 



X 



Literacy program 



X 



English as a second language 



X 



X 



X 



X 



Spanish for native speakers 



X 
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IS AISD'S SECONDARY TITLE VII PROGRAM HAVING AN IMPACT? 



PROGRAM IMPLEMENTATION AND SERVICES 

Costs 

The overall cost of Title VII in 1986-87 was $87,893, or $320*78 per 
student (274). Program implementation will be explored in terms of Title 
VITs four components. 

Staff Training 

Staff training provided ESL endorsement classes and teacher workshops. In 
1986-87, teachers could take the third and fourth of a series of four ESL 
semester courses leading to endorsement certification. Interested staff 
could also participate in workshops at the program schools. 

Endorsement Classes 

The following is true about the endorsement implementation: 

9 This year 14 program teachers enrolled in the third ESL course 
and seven enrolled in the fourth and final ESL endorsement course 
' (five finished the fourth course). 

• Three teachers completed all four courses offered in 1985-86 and 
198V87 leading to endorsement. 

0 Three courses were finished by five teachers and six completed 
two courses. One course was finished by 11 teachers. Thus, 25 
teachers were involved overall. 

• The three teachers completing all four endorsement courses 
instructed students in: 
Language 
Social Studies 
Vocational Arts 

$ Teachers completing two or more courses served students in: 
Reading Social Studies 

Language Science 
Mathematics Art 

• The total cost to Title VII for the tuition of the 21 teacners 
who enrolled in tne two endorsement classes in 1986-87 was 
$4,235, or $201.67 per endorsement participant. 
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The five AISD teachers who finished the last course were asked to complete a 
survey; three of them were program teachers who finished all courses in the 
ESL endorsement series. The following was expressed by these teachers: 

• Of the five teachers, four responded they had learned "a lot" from 
the last class; one stated that "some" learning had occurred, 

t Four of the teachers indicated tne ESL courses were worth their 
expenditure of time — one did not. 

# While two teachers believed endorsement class participation had 
improved their LEP students' English skills; two were more neutral. 
One did not have any LEP students. 

A count was done of the number of LEP students served by teachers who had 
completed two or more of the four endorsement courses in 1985-86 or 1386-87. 
It was felt that teachers enrolled in more than one course were more likely to 
use ESL techniques enough to have a measurable impact on students' learning 
Overall, 98 students were served. (See Figure 29.) Of course, other students 
were, or will be, impacted somewhat ~ those served by teachers participating 
in one class, non-LEP students, and students to be served in coming years by 
all endorsement teachers. However, in terms of program students, most of 
those served were at Travis where five teachers completed two or more 
endorsement courses. Most Travis students were taught by one of two ESOL 
teachers. She was bilingual ly endorsed through a grandfatner clause in tne 
state law, and took the courses to formalize her training. 

FIGURE 29* 
TITLE VII STUDENTS SERVED BY 
ENDORSEMENT TEACHERS IN 1986-87 



bchool 


Number Served 


7 


8 


9 


10 


11 


12 


Total 


Murchison 


1 


0 


0 


0 


0 


d 


1 


Anderson 


0 


0 


2 


0 


0 


0 


2 


Johnston 


0 


0 


10 


0 


0 


0 


10 


Travis 


0 


0 


39 


27 


14 


5 


85 


Total 


1 


0 


51 


27 


14 


5 


98 



Includes 14 teachers in two or more endorsement courses 



Teacher Workshops 

Workshops were implemented as planned and focused on two topics: 
0 Designing lesson plans for LEP students, and 

• Mainstreaming LEP students in secondary content area classes using 
cooperative learning techniques. 

*Figure numbers do not start with Figure 1, because this was taken from a 
longer report, Progra^ns for Students with Limited English Proficiency: 
Evaluation 1986"^^^ 
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The lesson plan workshop was held in December, 1986, and was attended by nine 
teachers. In-service evaluation questionnaires were filled out by 
participants. Teachers 1:idicated overall satisfaction with the workshop 
prograa and presenter in terms of: 

• Presentation and meeting of objectives, 
9 Interest level , 

• Presentation of information, 

• Effective uses of printed materials, 

• Usefulness of content, 

• Knowledgeability and preparation of presenter. 

Eight of nine respondents said they would like more related training* 

The second group of workshops, which focused on using cooperative learning 
for mainstreamed LEP students, was held during the spring of 1987. The 
series of five workshops, repeated twice, was attended by 18 program 
teachers. Teachers were asked to complete a pre- and post workshop survey. 

Participants surveyed at the beginning of the series had a wide range of 
familiarity with cooperative learning concepts and techniques. The seven 
teachers responding to the survey at the end of the course provided generally 
positive responses. 

• All were implementing cooperative learning techniques, 

• All felt adequately prepared to use the tecnniques. 

The pre- and post-survey responses for these seven teachers were reviewed for 
each of th^ 10 items. The number of responses which became more positive 
varied from 4 to 7 per item. AH teachers felt more comfortable defining the 
term "cooperative learning"; 6 of 7 believed they were able to organize 
effective cooperative learning groups and select appropriate materials for 
cooperative learning better. The two items for which only four of the seven 
teachers showed improved ratings at the end related to their familiarity witn 
research on cooperative learning and their comfort in using the techniques. 
The three who were somewhat familiar with the literature and almost always 
felt comfortable with the techniques initially were the ones whose ratings 
did not change after the workshop series. Thus, overall responses were 
positive. 

Tutor Assistance 

During 1985-86 and 1986-87, University of Texas tutors from multicultural 
classes assisted program LEP students. Plans for 1986-87 were to assign 
tutors to all four campuses both semesters. Tutors were assigned to all four 
progra.: schools first semester. Second semester, Anderson did not have any 
tutors because of proolems in assignment coordination and tutor 
transportation. First semester, 1986-87, 39 tutors were assigned to program 
LEP students at the four program campuses; 30 tutors were assigned second 
semester to program LEP students at three schools. In 1986-87, 120 program 
LEP students received tutoring services. This was considerably more than the 
78 program students in 1985-86 who were served. 
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Two data ccllection problems impacted counts of students served and 
comparisons of tutored and nontutored students' performance. Both problem*; 
may have resulted in some tutored students being assigned to the nontutorec 
group. 

• First semester, no tutor records were received from one school and botli 
semesters data were incomplete from all schools. Also, some tutor 
records lacked the last names of the tutored students. Attempts were 
made to trace last names, but in same cases it was impossible and data 
were lost. 

• This year other community groups have been tutoring at the four program 
schools. This was not determined until spring interviews. Names of 
those tutored by others were not available. Some program LEP students 
who were designated as nontutored may have actually been tutored. 

Evaluation findings examining the gains of tutored and nontutored program 
students may be found in this final report under English Proficiency and 
Englii>h Achievement. Significant difference^ in favor of tutored students 
were not found for English prv. ; icicency on t a LAB. While ITBS /TAP percentile 
scores increased more for tutored students than nontutored in two-thirds or 6 
of 9 comparisons, they could not be tested for significance because of small 
sample size. 

National research (Cohen, 1982) suggests peer tutoring programs are most 
effective when: 

9 Highly structured with well-planned curricula and methods, 

• Focused on oasic content and skills, and 

t Rela\ively short in duration (a few weeks or months). 

Title VII and UT staff should explore whether more extensive training of 
tutors could strengthen the program still further. More training of students 
in the use of FSL techniques might be particularly helpful, because most speak 
only English. Also, logs indicate tutors often worked with the whole 
class— this does not really constitute "tutoring." 

Parent Workshops 

This new 1986-87 component was impleniented as planned. A series of six 
workshops, repeated three times, dealt with the following topics. 

• Helping your children learn 
f Extracurricular activities 

• Preventing runaways 

• Helping your children say "no" to drugs and alcohol 
f Sexual problems of adolescence 
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t Ethnic differences in the role and authority of police in assisting 
students 

• Importance of communication 

§ Adjustment to a new culture and country 

• Hispanic conflicts and acceptance 
0 New immigration law 

Parent workshops were given by a Spanish/English speaking clinical 
psychologist^ with a background in education and counseling. Evaluation forms 
completed at each meeting indicated that parent attendance varied beiween 3 
and lOU. Attendance was reportedly even higher at some sessioiis based on 
staff reports (all may not have turned in evaluation forms). Overall, the 
evaluations were uniformly positive. 

Parents wanted more discussion about the following topics: 

9 Approaching sex education with their children 

0 New immigration law 

0 Drugs in adolescence 

t Helping children take advantage of school 

• Signs and cause? of homosexuality 

Curriculum Development 

Handbook sections on philosophy methodology/techniques, lessons, and 
videotapes were written and reorganized. The bibliography has been revised 
with new entries added. Also, a. consultant prepared a synthesis of different 
ESL methodologies with sample lessons. 



ENGLISK PROFICIENCY 

The Language Assessment Battery is a language proficiency test. Title VII 
project students were administered the English portion in the fall and spring 
to evaluate progress in English oral proficiency. The highest possible score 
is 92. 

The English proficiency objective was that students* average posttest 
percentile scores on the English Assessment Language Battery (LAB) would be 
higher than the pretest percentile scores. The objective was met by rtudents 
at grades 10, 11, and 12 (see Figure 30). AISD Title VII students in grades 7, 
8, and 9 had such limited proficiency that their scores remained at the first 
percentile despite raw score gains. Percentile norms are more sensitive to 
proficiency gains in the middle and upper ranges of scores. LAB norms are 
based on English speakers in New York City. Students with little English 
proficiency must earn 45 to 53 points to get beyond the first percentile 
(based on grade). Because percentiles were not considered an accurate measure 
of growtn at these gr^de levels, raw scores were also examined. 

Four out of six grade levels sho>red significant growth in raw scores-- grades 
8, 9, 10, and 11. 
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FIGURE 30 
LAB PERCENTILE AND MEAN RAH SCORES 
FOR PROGRAM STUDENTS, 1986-87 BY GRADE 



GRADE N 



MEAN RAW SCORE 



PERCENTILE 



SPRING 

MEAN RAW SCORE PERCENTILE 



n 18 

8 10 

9 27 

10 21 

11 9 

12 5 



35.22 
34.80 
39.50 
51.95 
58.67 
58.20 



1 
1 
1 
4 

5 

3 



^8744 1 

42.60* 1 

52.18* 1 

60.00* 7 

65.89* 8 

67.20 6 



* = Gains significant at p<.05 level 

In terms of English proficiency the following was also found; 

9 A slightly greater percentage of program participants made gains in 
1985-86 than in 1986-87. Of the program students with both pre- and 
posttests, 109 of the 131 (83.2%) 1985-86 participants made gains in 
the English LAB; in 1986-87, 71 (78%) of the 91 participants showed 
gains. 

e In terms of meeting District standards for showing English 

proficiency (23rd percentile on the LAB), this year four students of 
the 91 with pre- and posttest scores reacned proficiency. None 
reached proficiency last year. 

e The mean raw score gains of both the program students who were 
tutored by University of Texas students and those who were not 
tutored were highly significant (at the .0001 level). 

e Regression analysis revealed that there was no significant difference 
between the patterns of growth of the tutored and nontutored groups. 
Both groups showed raw score gains at all grade levels. In the 
tutored group these were significant at one out of six grade levels; 
nontutored raw score gains were significant at three out of six grade 
levels. (See Figure 31.) 

e The percentage of tutored students making gains in 1986-87 (86.4%) 
was considerably higher than that found in 1985-86 (47.2%). 
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FIGURE 31 

LAB PERCENTILE AND HEA» RAH SCORES FOR 
TUTORED/NONTUTORED STUDENTS IN 1986-87, BY GRADE 



TUTORED FALL 1986-87 SPRING 



mm N MEAN RAW SCORE PERCENTILE 


MEAN RAW SCORE PERCENTILE 


7 7 34.14 1 

8 5 31.00 1 

9 16 38.88 1 

10 9 52.44 4 

11 5 54.20 3 

12 2 42.00 1 


38.43 1 
36.80 1 
53.31* 2 
59.56 6 
65.20 8 
57.00 3 


NONTUTORED FALL 1985-86 SPRING 


GRADE N MEAN RAW SCORE PERCENTILE 


MEAN RAW SCORE PERCENTILE 


7 11 35.91 1 

8 5 38.60 1 

9 12 40.33 1 

10 12 51.58 3 

11 4 64.25 8 

12 3 69.00 7 


38.46 1 
48.40 2 
50.67* 1 
60.33* 7 
66.75 9 
74.00* 11 



* - Significant at p<.05 



In sumnary, English proficiency mean raw score gains were seen at all grade 
levels; these were significant at four out of six grade levels. Most 
individual students showed gains (78%), and a small group were able to show 
English oral p?t)ficiency this ^ar. 

Wnile no significant difference between the tutored and nontutored groups in 
LAB gains from pre- to posttesting was evident, several factors may have 
affected these outcomes. All tutor records were not returned, so some 
students in the nontutored group may actually have been served. Also, this 
year other service groups offered tutoring to students at the program schools; 
some LEP students may have been served but this is unknown. Some students 
were at schools that had tutors for two years, while others were part of a 
newly implemented tutoring program this year. How these variables influenced 
the outcomes is unknown. 



ENGLISH ACHIEVEMENT (ITBS/TAP) 

Most Title VII students have not been in AISD or its programs for LEP students 
for very long. Two-thirds (65%) of the 120 junior high and 59% of the 132 
senior high students in Title VII at year's end had been participating less 
than two years. Students had to be in AISD a min imum of 1.1 years to be in 
the achievement analyses since scores for May,'T58b and 1987 were required. 
Overall, 56% of the Title VII students could be validly tested both years. 
Students in AISD LEP programs less than two years represented 42% of those 
tested. 
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Grade Equivalent Scores— 1986 to 1987 

Most analyses were performed using percentile scores as required by program 
objectives. However, grade equivalent scores offer another perspective on the 
growth students demonstrated. Gains at the three Title VII high schools 
combined and Murchison Junior High are shown in Figures 32 and 33. 

Students scored below the national norm in Doth 1986 and 1987 in all areas. 

Students scored closest to the national average in mathematics. Gains of 

greater than 1 GE help these students close the gap between their performance 
and the national norm. 

e ^rchlson 7th and 8th graders showed average gains exceeding 1 GE In 
reading^ language^ and taatheaiatlcs at grade 7. Grade 8 average 
math^etlcs gains were considerably less than 1 GE (.69). Last year's 
mathematics gain was also below 1 GE. Murchison had no 8th grade 
bilingual matnematics teacher for part of List year; this year 
Murchison was still understaffed in mathematics— one period each of 
seventh and eighth grade bilingual mathematics was taught. Thus, many 
Title VII students had mathematics with an English-speaking teacher. 

• Title VII high school average gains exceeded 1 GE In oiathaiiatlcs and 
language at all grades (10, 11, 12} but were considerably less than 1 
GE (.2 GE) In reading at grades 10 and 12 (.4 GE). Grade 11 reading 
gains were strong (1.6 GE). The number tested was less than 20 at 
grades 11 and 12. The reason for the low reading gains is unclear. 
Grade 9 gains cannot be discussed because students are tested with the 
ITBS in grade 8 and the TAP in grade 9. Test characteristics and norms 
are too dissimilar to allow valid comparisons. 

Percentile Scores (1986-87) 

Overall English achievement outcomes were evaluated in terms of the formal 
objective which stated that program students average posttest percentiles 
(spring, 1987) would be higher than their average pretest percentiles (spring, 
1986). 

Figures 34 and 35 show that the objective was met In each subject by most 
grade levels; percentiles Increased In 17 of 23 comparisons by subject and 
grade. 

• By subject, mathematics was the best area, with gains at all grade 
levels. Reading and social studies showed the least improvement. 

. © By grade, grade 7 showed the best performance, with gains in all 
areas. Grades 10 and 12 improved in the fewest areas (3 of 5). 
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FIGURE 32 
TAP MEAN GE SCORES 
TITLE VII HIGH SCHOOLS ONE- YEAR FOLLOM-UP— 
1986 (PRE) AND 1987 (POST) 



MATHEMATICS 



I 
I 

I GRADE 

I 

109 
I 

119 
III 
112 

I 

iTOTAL 



TOTAL 
IN 
CROUP 



i NUMBER ) PREMATH IPOSTHATH IHATKGAIN 
I TESTED i MEAN | MEAN | MEAN 

•4- 



I 



I 



LANGUAGE 

NUMBER 1 PRELAN6 IPOSTLANG ILANGGAIN 
TESTED I MEAN | MEAN I MEAN 



READING 



I 



I 



I 



NUMBER I PREREAO | POSTREAO iREADGAIN 
TESTED I MEAN 1 HEAN I MEAN 



60 
41 
19 
13 
133 



321 



20i 
131 
91 



741 



I 7.891 
7.471 9^04! 
8.381 9.581 
9.64i 11.141 
8.891 



8.171 




Note: Gains could not be calculated at grade 9 because students were tested at grade 8 with the ITBS. 1982 norms. 
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FIGURE 33 
GRADE 7 MURCHISON TITLE VII 
ITBS GE SCORES SPRING. 1986 AND 1987 



GRADE EQUIVALENT SCOflE 
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GRADE a MUBCHISON TITLE VII 
ITBS GE SCORES SPRING. 1985 AND 1987 



GRADE EQUIVALENT SCORE 

3.0 
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7.0 
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in Spanish or balanced in English and Spanish. 
N » 30-33 
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FI6URE 34 

PERCENTILE 6AINS OF TITLE VII STUOEHTS OH THE 1987 ITBSAAP 
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FIGURE 35 
GRADES MEETING THE ACHIEVEMENT 
OBJECTIVE OH THE 1987 ITBSAAP 



mmf AREA 


OBJECTIVE Met 


Objective UhHtT 


Reading 


/.8.11 


10,12 


Language 


7,8,11,12 


10 


Mathematics 


7,8,10,11,12 




Social Studies 


7,10,11 


8,12 


Science ■ 


**10.12 


11 



* Ninth graders were excluded .from all analyses, because they took the ITBS 
in 1986 and the TAP in 1987. 

* Grades seven and eight do not take the science test. 



Additionally, the overall student gains were examined for tutored and 
nontutored students. Grades 7-8 and grades 10-12 were collapsed to adjust for 
the small numbers tutored at individual grades. As can be seen In Figure 36, 
tutored students exhibited more improvenient than nontutored in two-thirds or 6 
of 9 comparisons. Sample sizes were too small for significance testing. 

FIGURE 36 

PERCENTILE GAINS OF TUTORED AND NONTUTORED 
TITLE VII STUDENTS ON THE 1987 ITBS/TAP 





Tutored 


Reading 


Language 


Mathematics 


Social Studies 


Science 


Grade 




H 


Median 




H 




Median 




H 


Median 




N 


Median 




ti 


Median 








Pre Post 


Gain 




Pre 


Post 


Gain 




Pre Post 


Gain 




Pre Post 


Gain 




Pre Post Gain 


7-8 


Yes 


19 


4 13 


9 


18 


12 


19.5 


7.5 


11 


18 23 


5 


0 


0 0 


0 








No 


49 


5 11 


6 


44 


7 


12.5 


5.5 


57 


12 24 


12 


63 


11 12 


1 








Total 








62 








68 
















10-12 


Yes 


3 


1 11 


10 


7 


1 


8 


7 


3 


6 20 


14 


2 


18 7 


-11 


4 


3 18 15 




No 


37 


9 8 


-1 


32 


11 


16.5 


5.5 


37 


23 33 


10 


35 


10 11 


1 


33 


8 14 6 




Total 


40 






39 








40 






37 






37 





Only students tutored In each area with pre- and posttesU are Included^ no one tutored in social studies at 
grades 7 and 8 had both scores* 

do 
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Also, the percentage of those students with gains in 1986-87 was compared to 
those with gains in 1985-86. The results are shown in Figure 37. In 1987. a 
greater percentage of tutored students made gains in reading, mathematics, and 
science. However, caution should be noted in interpreting the findings; the 
number of tutored students with ITBS/TAP scores (excluding grade nine) in 
1987, was much smaller than in 1986. (The N was so small in both social 
studies and science that no real comparison can be made.) 

FIGURE 37 



PERCENTAGE OF TUTORED STUDENTS WITH 
ITBS/TAP GAINS 1985-86 AND 1986-87 



100 r 




READINS LANBUASE MATHEMATICS SOC. ST. SCIENCE 



Scores of both yssrs' nlntti 
graders were excluded 



16 
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SPANISH PROFICIENCY ViD ACHIEVEKENT 

Spanish proficiency^and achievement was measured by La Prueba Riverside de 
Realizacion en Espanol (Prueba Riverside), which measures achievement in 
reading, language, mathematics, social studies, and science; it is designed 
to be of comparable difficulty to the Iowa Tests of Basic Skills. The 
nighest possible raw score varies from 25 to 30, depending upon the 
subtest. La Prueba Riverside v^fas administered at Murchison, because Title 
VII LEP students received billnijual instruction in the content areas plus 
ESL. At Travis, LEP students rkceived one daily period each of Spanish for 
Native Speakers and ESL; content areas were taught in English. In the case 
of Travis, La Prueba Riverside was. administered to evaluate school 
achievement in the students' more fluent language. 

The two objectives used to evaluate students' Spanish proficiency and 
achievement stated that the percentage of Title VII Program students making 
gains in language and other content areas would be higher in 1986-87 than in 
1985-86. Overall, the percentage of students makinc gains increased in 
every subject area. As can be seen below, both schools met the objective in 
three of five areas, narrowly missing the objective in the other areas. It 
should be noted that Murchison has had limited bilingual mathematics 
instruction over the past two years. 



FIuJRE 38 

PERCENTAGE OF TITLE VII STUDENTS SHOHING 
GAINS LA PRUEBA RIVERSIDE 



SUBJECTS 


MURCHISON 


TRAVIS 




N 


1985-86 


N 


1986-87 


N 


1985-86 


N 


1986-87 


Reading 


75 


6li 


lOl 


73^ 


12 


m 


47 


75% 


Language 


75 


5S% 


101 


72% 


13 


54% 


47 


53% 


Mathematics 


76 


67% 


101 


65% 


13 


. 46% 


47 


81% 


Social Studies 


76 


54% 


101 


60% 


12 


75% 


47 


72% 


Science 


76 


57% 


99 


• 57% 


12 


42% 


47 


57% 



Mean raw score gains were exaisalned by grade level; 16 of 20 comparisons were 
significant (see Figure 39). Actual scores are shown in the technical 
report. 

9 'Grade 7 showed significant gains in all subjects, with grades 9 and 
10 showing significant gains in four of five areas. Grade 8 showed 
significant gains in three areas. 

t Significant gains were seen at all four grade levels in reading and 
mathematics; gains were significant in language and social studies at 
three grades and in science at two. 
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Thus, Prueba Riverside results were quite positive. 



FIGURE 39 
GRADE LEVaS WITH SIGNIFICANT AND 
NOT SIGNIFICANT GAINS ON LA PRUEBA RIVERSIDE ~- 1986-87 



SUBJECT 


SIGNIFICANT 


NOT SIGNIFICANT 


Reading 


7,8,9,10 




Language 


7,8,9 


10 


Mathematics 


7,8,9,10 




Social Studies 


7,9,10 


8 


Science 


7A0 


8,9 



Gains significant at p<*01 level or greater 



DROPOUT RATES 

Figure 40 shows the 1985-86 secondary dropout rate of program LEP A and B 
students (English monolingual, or Spanish dominant) and other LEP C,D, 
and E students (bilingual, English dominant, and English monolingual) 
attending Title VII program campuses. Rates cover the period of 
September through July of 1985-86. Students are considered dropouts if 
they leave AISD during the year and a request for a transcript is not 
received by July 1* LEP dropout rates are overestimates to the extent 
that students return to other countries that do not request transcripts* 

• The LEP dropout rate for Spanish speakers at the four Title VII 
schools overall (18%) was well above the District rate (10.7%) and 
sligntly above the District's Hispanic rate (15*3%)* 

9 The rate for program students (LEP A and B) was slightly lower 
(18%) than that for LEP C, D, and E students (20%) at the Title 
VII schools. 

• The LEP dropout rate was highest at grade 9 (37%) with little 
difference between program and other LEPs at the schools for both 
program students and for other LEP students at the schools. 

• Murchison Junior High LEP students were less likely to drop out 
(90%) than Title VII senior high schools, regardless of their LEP 
status. 
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FIGURE 40 

ANNUAL 1985-86 SECONDARY DROPOUT RATE FOR TITLE VII SCHOOLS 
SPANISH DOMINANT/MONOLINGUAL (LEP A & B) VERSUS 
OTHER SPANISH LEP (C, D, & F) STUDENTS 



Group 



LEP A & B STUDENTS 



School Dropouts Enrollment Dropout % 



Murchison 

Travis 

Johnston 

Anderson 

TOTAL 

Grade 



10 


109 


9% 


4 


40 


20 


58 


34% 


5 


17 


4 


17 


24% 


5 . 


21 


0 


9 


0% 


6 


24 


34 


193 


18% 


20 


102 



7 


3 


42 


7% 


8 


7 


67 


10% 


9 


17 


45 


38% 


10 


6 


27 


11% 


11 


1 


12 


8% 


12 


0 


0 


0% 


TOTAL 


34 


193 


18% 



LEP C.D.E STUDENTS 



Dropouts Enrollment Dropout % 



m 
m 

20% 



2 


17 


12^ 


2 


23 




13 


37 


35^ 


2 


14 


14^ 


1 


11 


% 


0 


0 


0% 


20 


102 


20% 



COMBINED LEP STUDENTS (A.B.C.D.&E) 



Dropouts Enrollment Dropout % 



14 


149 


9% 


25 


75 


33% 


9 


38 


24% 


6 


33 


18% 


54 


295 


18% 


5 


59 


8% 


9 


90 


10% 


30 


82 


37% 


8 


4i 


20% 


2 


23 


9% 


0 


0 


0% 


54 


295 


18% 
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INTRODUCTION 

The Title VII evaluation requires a great deal of data analysis. Austin 
Independent School District (AISD) has provided considerable data analyst 
and evaluator time in setting up and running these analyses. Pre- and 
posttest of three tests (Prueba Riverside, Iowa Tests of Basic Skills, 
and Test of Achievement and Proficiency) were analyzed by grade and test 
area. In addition. Language Assessment Battery (LAB) results in English 
were analyzed for pre- and posttest. Program notes and program 
descriptions are attached. Much of the data were re- analyzed by tutored 
and nbntutored groups and significance testing was done. 
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NUI£S l-UR BARbARA YCNAN SA-0Y999 OlOl 06/16/87 

OAIA SEIS 

SA-etOul 0102 

PRUfcBA - FALL 1985 
LAB - FALL 1985 
LAb - SPRING 1986 
FKCK hOUR SCHOULS 003 007 009 052 



INPUT 


FILEfiD 


$ 1-3 




STUIO 


$ 4-10 




STNAHk 


$ U-30 




GRADE 


S 31-32 




SCHOOL 


S 33-35 




READ 


36-37 




LANG 


38-39 




HATH 


4 0-41 




COHP 


42-43 




SOCST 


44-45 




SC 


46-47 




COi'tPREH 


48-50 




vacAB 


51-53 




hORKSTU 


54-56 


357 


PRHENG 


Z02« 


959 


POSTENG 


Z02« 


961 


PRESPAN 


ZD2* 


963 


POSTSPAN 


ZO2;; 


IF PREEN6 


GT 0 AND 


POSTENG GT 0; 



CAROS; 

«INCLUOE>SA-By00l0l02 



SA-BYOOl 0103 

PKUEBA - SPRING 1966 
INPUT FILEIO 
STUIO 
GRAOE ' 
REA02 
LANG2 
HATH2 
C0HP2 
S0CST2 
SC2 

CAROSi 

«INCLUUC>SA-BY001U103 



1-3 

4-10 

31-32 

36-3? 

38-39 

4 0-41 

42-43 

44-45 

46-47; 
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SA-OYOOl 0104 

PRUEBA - FALL 1986 ♦» DIFFERENT LAYOUT FROM OTHER PRUEBA TFSFS 

INPUT FILEIO $ 1-3 

STJIO i 4-10 

STUNAHE $ U-30 

GKAOn t 31-32 

SCHUOL $ 33-35 _ 

28 



0010 
0020 
0030 
0040 
0050 
0060 
0070 
0080 
0090 
0100 
00000110 
00000120 
00000130 
00000140 
00000150 
00000160 
00.00170 
00000180 
00000190 
00000200 
00000210 
lDb000220 
00000230 
00000240 
00000250 
00000260 
00000270 
v>0000280 
00000290 
00000300 
00000310 
00000320 
00000330 
0340 
0350 
0360 
'00000370 
00000380 
00000390 
^0000400 
00000410 
00000420 
30000430 
30000440 
00000450 
br-'0046Q 
00000470 
00000480 
00000490 
0500 
0510 
0520 
00000530 
00000540 
00000550 
00000560 
00000570 



TMLL Vll * l*iH6-07 SCilu^l 


YEAR HASTCK 


F ILC 




1180 


SCl CiCL OCit 007 1 00V« 052 










1 190 


STARS 2t At H 










1200 


DtKlNANCi: A» dt C 










I2I0 


tti:>PAN'lC - LAMGCUDb > CU2 










1220 


FALL E\C;LISH LAB SCUHtS ^ 


MUST HAVE BEEN lAKEN IN 


SEPT 


OR 


OCT CJF 


1986. 1230 


itSPUl STOlu 


1-7 








0000U40 


STUNAMh % 


8-34 








00001250 


SCMGOL i 


36-38 








00001260 


hORAOE ( 


39-40 








00001270 


STATUS $ 


42 








00001280 


DOHINANC ( 


43 








00001290 


^4£> rALLLAB 


Z02. 








00001300 


aI48 SPRGLA8 


Z02. 








00001310 


ENOURSE 


51 








1320 


TUTRCAO S 


53 








1330 


rUTLANG S 


54 








1340 


PjrHATH $ 


55 








I35r 


TbTSOCST $ 


56' 








1360 


TUTSC $ 


57; 








1370 


fALL86 - FALLtAB; 










00001380 


K(L'P STUIO STUNAHE SCHOOL GRADE STATUS OOHINANC ~ 


FALL86; 


00001390 


CAROS; 










00001400 


«I.NCLUDE>SA-BY0040102 










00001410 


• 










00001420 
1430 
1440 
1450 


bARU81»U& THIS hiLL BE A 


SAS OATASET « JOHN WILL 


CREATE. 




1460 


input: EOY H86 LEP Plic. 










1470 


ACTIVE UNLY 










148C 


LANGDOM OF A C 8 










490 


HISPANIC 










*;oo 


SCHOOLS 0C3 007 009 


052 








i510 


STATUS 2 C 8 










1520 


♦ 










1530 


SPECIAL LIST FROM BARBARA 








1540 


89653 










1550 


9C090 










1560 


53056 










1570 


90520 










1580 


49785- 










1590 


53056 










1600 


68054 










1610 


89791 










1620 


90070 










1630 


90371 










1640 


05942 










165i 


23357 










1660 


ADD 1986 I IBS UK TAP PERCENTILES L GE*S 






29 


1670 
1680 


AUD l<;d6 irOS OR TAP PERCENTILES £ GE*S 








1690 












1700 


MBS: 


TAPt 








1710 


KEAOii%G TOTAL 


AEAOING 








1720 


KAiH lUTAL 


HATHEHATICS 








1730 


LANG TUTAL 


WRITTEN EXPRESSION 








1740 


nCRK STUDY SKILLS TOTAL 


SOCIAL STUOIES 
SCIENCE 








1750 
1760 
1770 





TEACHER 


$ 'i6 




00000580 




REA02 


37-38 




00000590 




LANG2 


39-40 




00000600 




HATH2 


41-42 




00000610 




C0HP2 


43-44 




00000620 




S0CST2 


45-46 




00000630 




SC2 


47-48; 




00000640 


CARCS; 








00000650 


♦ l.jCLUUb>SA-8Y00lOIC4 






00000660 


* 








00000670 
OOOOOooO 
0690 


SA<»BYOOI OIOS 








0700 


TUTOR DATA 






0710 


HHIGiNAL LIST CAHE FHOH 


EOY 1986 LEP FILE 




0720 


ACTIVE 


ONLYf LANGCCN 


A C Bt HlSPANICf STATUS 


2 £ 8t 


0730 


SCHOOLS 003 C07 0C9 


052 




0740 


8AR8AftA WILL ENTER 


TUTOR OAT A AND 




0750 




AOO EXTRA STUDENTS. 




0760 


INPUT 


SCHOOL 


1-3 




00000770 




GRAOE 


> 5-6 




00000780 




STUlU 






00000790 




STUNAHE 


( 16^35 




00000800 




SEMESTER 


» Jo 




00000810 


340 


TUTREAO 






000C0820 


d45 


TUTLANG 


■ cut* 




000G0830 


950 


TUTMATH 






00000840 


355 


TUTSOCST 






00000850 


360 


TUTSCI 






00000860 


ro TUTTOTAL 


* o; 






00000870 


TUTTOTAL 


TUTREAO; 






00000880 


lUITGTAL 


f tutlakg; 






. 00000890 


TUTTOTAL 


f tutkath; 






00000900 


TUTTOTAL 


f TUTSOCST; 






00000910 


TUl TOTAL 


♦ TUTSCI; 






000009^0 


KEP.P STUIO TUTTOTAL; 






UUUUUM JU 


CARCS; 








UUUUUV'tU 


♦ 1NCLCDE>SA-*BY00I0IC5 






UUUUU73U 


• 








UUUUU70U 
UUUUU^ / U 
0980 


SA-dVOOI 0106 








0990 


pfiufcaA - ' 


SPRING 1987 






1000 


I.NPUT 


r-lLElO 


i 1-3 




DOOOIO 10 




STUIO 


$ 4-10 


* 


nnnn t a on 
UUUU iUZD 




STUNAHE 


$ 11-30 




n nn n t A O n 
UUUU 10 JO 




GRAOE 


* 31-32 




UUUUI 040 




SCHOOL 


$ 33-35 




HAAAt AC^A 

UOOOlOsO 




REA02 


36-37 




A AA A t A Z. A 

UUUU lOoO 




LANo2 


38-39 




00001070 




;UTH2 


40-41 




00001080 




CbMP2 


42-43 




flfl A fl t A f 1 A 
UUUU lUVU 




SGCST2 


44-45 




VUUUl lUU 




SC2 


46-47; 




00001110 










00001120 








00001130 
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30 


00001140 

ooooue»o 

1160 










1170 



1760 

##«4««««^»«v»^#« PhOGKAKS 1790 

1800 

SA-HYOOl OlOl 1610 
INPUT: SA-*BY001 0102 1820 
I960 LEP fiLE 1830 
RUN AT aI^F£RENT TIMES TO AOO LAB SCORES FROM THE LEP FILE ON TO THE 1840 
CAKO FILE* THE UPOATLO FILE (SAS) toAS THEN WRITTEN TO THE PUNCH QUE 18S0 
WHERE IT CJULD 8E LOAOEO 8ACK INTO THE SPH CARO FILE ( SA-BYOOl 01021. i860 

1870 
1880 

SA-DY002 OlOl 1890 
INPUT: SA-BYOOl 0102 1900 
SGKT ANO PRINT IN DIFFERENT SEQUENCES 1910 
PKOC TABULATE USING PRE C POST LAB SCORrS 1920 

1930 

SA-BYCO^ u^ul l^-^O 
INPUT: SA-BYOOl 0102 1950 
CREATE ENG LAB GAINS i960 
INPUT: EOY 19B6 LEP FILE FOR OCHINANCE AND STATUS 1970 
output: 1980 
SELECT ANO HRiNT THOSE WITH LANGOOH A C B - 1990 
SELECT ANO PRINT THOSE WITH STATUS 2 C 8 2000 
HROC HEANS 2010 
LA8GAINS PRELA8 POSTLAB 2020 
SORT BY GRACE 2030 
AiWOlHER PPOC MEANS 2040 
SORT BY SCHOOL 2050 
ANOTHER PROC MEANS 2060 
^ PROC TABULATES CrHHETEO OUT. 2070 

2080 

SA-BY002 0 301 2090 
iNPUl: SA-BYOOl 0102 2100 
CREATE ENG LAB GAINS 2110 
INPUT: SA-BYOOl 0105 2120 
CREATE TOTAL TIME TUTOREO 2130 
MERGE C CREATE TUTOREO GROUPS 2140 
MEANS £ PROC TABULATES OF TUTOREO GROUPS X PRELABt POSTLAB, LABGAIN 2150 

2160 

SA-6Y002 0401 2170 
input: BARB85d6 - SAS DATA SET 2180 
CREAIE CAINS IN EACH SUBJECT AREA 2190 
INPUT: SA-BYOOl OlOS - TUTOREO T IHE IN EACH SUBJECT AREA 220r 
MERGE L CREATE TUTUHEO GROUPS IN EACH SUBJECT AREA 2210 
MEAr^S L PRJC TABULATES OF TUTCREO GROUPS X PRE t POSlt GAIN 2220 

2230 

SA-0YOO2 0501 2240 
INPUT: SA-BYOOl 0102 2250 
CREATE ENG LAC GAINS 2260 
INPUT : SA-tlYOOl 0105 2270 
CKEAIE IGTAL 1 IHI: TUTOREO 2280 
CROUP » - NOr TUTORED GROUP 2 - TUTORED OI 2290 

l^Uii^ 0± 2300 

i^U.N PLCrS ANi) SUKt SPOT CN TUO GROUPS 2310 

2320 
2330 

>.\- rxjjj 01 CI 2340 
i;j»oT - PkUUjA 2350 
-•|,;Rt s^ICN ANALYSIS 2360 

2370 
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|.,i»U|: FKutU • SPRING l*#lJo C fALL i^Hb . 2390 

(.it ATLO :UTh viAlNS 2400 
PMjC uN'iVARiAFfc 2410 

2420 

SA-BY003 0301 2430 
INPUT: PF.UL.JA - FALL 19H5 t SPRING 1986 2440 
CKhAIf: GAINS 2450 
PilNT - ANVHAV YOU LIKE IT* 2460 

2470 

SA-8YC0i 0401 2480 
I.SPUI: PKUEBA - FALL 1936 (SA«BY001 0104) DIFFERENT LAYOUT*** 2490 

PKINT FILE 2500 

• 2510 

SA-byLw3 0501 2520 
I.%t>UT: PRUfcBA - FALL 1986 ISii-BYOOl 0104) OIFFEf»ENT LAYOUT*** 2530 

PRUEBA - SPRG 1986 (SA-BVOOl 0103) 2540 
PRUEBA • FALL 1985 CSA-BYOOL 0102.' 2550 
CCMUIKD FILES AND PRINT BY TEACHER 2560 
blOOENT MUST HAVE FALL 19B6 RECORD TD BE INCLUDEO IN COMBINED FILE. 2570 

2580 
2590 

SA-8Y004 0101 2600 
I.NPUl: LEPFIL 2610 
OUTPUT: TITLE Vll STUDENTS kITH FALL ENGLISH SCORES^ 2620 

?630 

SA-8Y0U4 0201 2640 
li4PUT: SA-BYOOl 0102 ENG LAB FALL85 C SPRG66 2650 
SA-BY004 0102 ENG LAB FALL86 2660 
LEPFIL ENG LAB SPRG87 t UPDATED JNFD FDA EACH STUDENT 2670 

UUIPUT: IF iOH SA-BY004 0102 'DR HAO 04/B7 ENG LAB SCORE DNLfcP FILE) 2680 
' AND ARE CURRENTLY ACTIVE: 2690 
PRINT LAB SCORES FDR EACH STUDENT BY SfHODLt GRADE t STUNAHF. 2700 

2710 

SA-8Y004 0301 2720 
input: SA-BY004 0102 TITLE VII MASTER FILE 2730 
LEPFIL • 2740 

OUTPUT: TITLE Vll MASTER FILE TO PUNCH Ul TH SPRG LAB SCORES 2750 

2760 

SA-BY004 0401 2770 
input: SA-8Y004 0102 TITLE VII MASTER FILE 2780 
^•RYENOl FRYEND2 FRYEND3 - SAS FILES OF STUDENTS WHO HAD 2790 
CLASSES hITH ENDORSED TEAHERS* ~ 2800 

output: title VII MASTER FILE TD PUNCH KITH NUMBER OF COURSES WITH 2810 
ENOORSeO TEACHERS* 2820 

2830 

SA-BVCOT 0101 2840 
INPUT: SGR TAPE FILE 2650 
SELECTING ON SCHODLi GRACE* AND ESOL COURSE NUMBERS 2860 

2870 

SA-QVOOa 0101 2880 
INPUT: CURRENT LCP FILE 2890 
CUTPUr: TITLE VII STUDENT RCSTERS 2900 

2910 

SA-BYOOB 0201 2920 
INPUT: CURRfcNT LEP FILE ILEPFIL) L STUDENT MASTER <STUMST) 2930 
HCRGE 2940 
TABLES OF SCHOOL X LOW INCt>HE* 2950 

2960 

gj^^ SA-UY009 OlCl 22 2'y70 



INPLT: EOY 1986 LEP FILE 2980 
OtTPUT: TITLE Vll SILUENT RCSTERS 2990 

3000 
3010 

SA-Jf05l 0301 3020 
INPLT: EOY 1986 LANG FILE CEL6LANC6) 3030 
OUTPUT: BAK086 * SAS DATA SET «• TITLE VII STUDENTS FROM 1966 3040 

3050 

SA-JF051 0401 3060 
IiNPUT: 0ARB86 3070 
I TBS 1986 (VSAK» UBSHST 3080 
TAP 1986 tVSAH) STEPFL 3090 
OUIPUI: BARU86 WITH TEST SCORES FOR 1986 3100 

3110 

SA-JFOSl 0501 , 3120 

INPUT: BARQa6 bITH TEST SCORES FOR 1986 3130 
ITaS 1965 • ESWl rB29 3140 
TAP 1985 «• EShTAP03 3150 
OUTPUT; BARBd586 - TITLE Vll STUDENTS UlTH ITBS C TAP SCORES 3160 
FROM 1985 £ 1986 3170 

3180 

iiOlTTO EOJ 18510090 
iV) CAK'^S TRANSFERRED 
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LANGUAGE ASSESSMENT BATTERY 



Purpose 

The Language Assessment Battery (LAB) is administered in English to provide a 
means of determining the English proficiency of secondary pupils for whom 
English is not the primary language spolcen. The highest possiblr score is 
92. The LAB was used to provide information concerning: 

Decision Question Dl ; Should AISD adopt the Title VII Program 

Cosiponents when federal funding expires? 

Objective #1 • English Proficiency: By the end of each project year, project 
students' average posttest percentile scores on the English Language 
Assessment Battery (LAB) will be higher than the pretest percentile scores* 
(All schools) 

Evaluation CKiestion Pl-1 > Did program participants exhibit 
percentile gains, on the average, in their English language 
proficiency? 

Evaluation Question Dl-2 > Did the percentage showing raw score 
gains exceed that of last year? 

Evaluation Question Dl-3 > Did participants who were "tutored 
exhibit greater percentile gains, on the average, in English 
proficiency compared to those not tutored? 

Evaluation Question Dl->4 > Did the percentage of tutored program 
participants making gams exceed that found last year? (all four 
schools) 



Procedure 

The LAB was administered to all project participants (LEP A & B students) 
between September 29 and October 23, 1986, to provide a baseline comparison 
with results from the April and May, 1987 re-evaluation. At Murchison, the 
TBE teachers administered the group segments of the test; the TBE teachers 
also gave the individual part, assisted by Office of Research and Evaluation 
(ORE) staff members. At Travis and Johnston, the LPAC chairperson (LEP 
coordinator) administered the LAB; ORE staff members assisted in the 
administration of the individual segn^ents at "^ravis. The program teacher 
specialist and LPAC coordinator at Anderson administered both the group and 
individual parts of the LAB* 

FroiTi April 13 to May 4, 1987, the posttest was administered at the four 
schools using the same procedure except at Murchison, where the individual 
segments of the LAB were given by the ORE evaluation associate, assisted by 
the program teacher specialist • 
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LAB scores were entered on a computer terminal by the part-time clerk for 
bilingual programs. The prograimier analyst wrote a program and transferred 
the pretest scores to a Statistical Analysis System (SAS) data file tape 
SA-BYOOl-0102 in February of 1987. Posttest scores were entered and merged 
with the pretest scores of 1986-87 on the original 1986-87 Title VII Master 
File. Student gains were examined in two ways. First, using the data on 
file, the percentage of 1986-87 raw score i»vudent gains were hand tabulated 
from the number showing gains from a PROC TABULATE procedure of SAS program 
SA-BY005-0101 in June 1987; the percentage gains were then compared with those 
found for 1985-86 Title VII LEP program students, overall and by 
tutored/nontutored groups. Second, percentile gains, on the average, for all 
Title VII LEP program students enrolled between September 30, 1986 and May 30, 
1987, and subgroups of tutored and nontutored, were examined. To do this, the 
programmer analyst modified SA-BY004-0201 which then calculated raw score mean 
gains of all program students and the two subgroups. These mean raw score 
gains were transformed into equivalent percentiles, using the LAB Technical 
Manual (See Attachment A-1). A PROC 6LM was run to evaluate the impact of 
tutoring on posttest outcomes in SAS program SA-BY004-0401. The regression 
models used in this comparison were tested for significance with F tests, 
calculated using SAS program SA-CL017-0401. 



Results 

Objective #1 - English Proficiency: By the end of each project year, project 
students' average posttest percentile scores on the English Language 
Assessment Battery (LAB) will be higher than the pretest percentile scores. 
(All schools) 

Evaluation (H^estion Dl'"l > Did program participants exhibit percentile gains, 
on the average. In their ^nglish language proficiency? 

A discussion of LAB norms is necessary before scores are examined. LAB norms 
are based on average English speakers in New York City (See Attachment A-1). 
The LAB is more sensitive to measuring English proficiency at the mid- and 
upper ranges of scores. Students must earn 45 to 53 points to get beyond the 
first percentile (based. on grade). The highest possible score is 92. For 
AISD Title VII students, those in grades 7, 8, and 9 had such limited 
proficiency that percentiles were not an accurate measure of growth. 
Achievement of objective #1 will therefore be discussed in terms of growth in 
percentiles and raw scores in fairness to the program. 

As can be seen in Figure A-1, when program student percentile gains were 
examined by grade, students in grades 10, 11 and 12 demonstrated percentile 
gains in their English language proficiency. All grade levels made gains in 
raw scores. Correlated t-tests showed these gains to be significant at grades 
8, 9, 10, and 11 but not at grades 7 and 12. (Sample size at grade 12 was 
only 5 students, making it significantly more difficult to achieve.) 
Attachment A-2 provides information on the scores. 

36 



APPENDIX A 



86.42 



FIGURE A-1 
LAB PERCENTILE AND MEAN RAU SCORES 
FOR PROGRAM STUDENTS, 1986-87 BY GRADE 



GRADE N 


FALL 

RAW MEAN SCORE PERCENTILE 


SPRING 

RAW MEAN SCORE PERCENTILE 


7 Lti 

8 10 

9 27 

10 21 

11 9 

12 5 


35.22 1 
34,80 1 
3S.50 1 
51.95 4 
58.67 5 
58.20 3 


38.44 1 
42.60* 1 
52.18* 1 
60.00* 7 
65.89* 8 
67.20 6 



*Gains significant at p<.05 level 



Thus, in tenas of percentiles, the objective was met at 3 of 6 grades (all 
high school)* In terms of raw scores, significant gains were seen at 4 of the 
6 grades. 

Evaluation Question Dl-2 * Did the percentage showing raw score gains exceed 
that of last year? 

A slightly greater percentage of program participants made gains in 1985-86 
than in 1986-87. Of the 131 LEP program students, 109 (83.2%) made gains in 
the English LAB in 1985-86 whereas in 1986-87, 71 (78%) of the 91 program 
participants with both pre- and posttests showed gains. 

Another measure of success for the program is the number of students able to 
show English proficiency based on District standards (the 23rd percentile). 
Of the 90 students with pre- and posttest scores, four reached proficiency 
this year. In addition, 11 students without pretest scores reached 
proficiency in English. In 1985-86, none of the Title VII students reached 
English proficiency. 

Evaluation Question Dl-3 * Did participants who were tutored exhibit greater 
percentile gains on the average, in English proficiency compared to those not 
tutored? 

For the second year. University of Texas students from multicultural classes 
assisted program LEP students. Three of the program schools received tutoring 
assistance both semesters, but one ended the second semester with only four 
tutors finishing* Anderson had tutors only during the first semester. It 
must be noted that some tutor records were not returned and that tutors from 
other organizations may have tutored some LEP students. Therefore, those not 
tutored may include some tutored students. For more details, see Appendix D- 
Tutor Records. 
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In order to answer this decision question, program LEP students were 
considered in the tutored subset if they had received tutoring either semester. 

Figure A-2 examines the percentile gains of tutored and nontutored program LEP 
students in grades 7 through 12 for school year 1986-87. Tutored students 
showed percentile gains in grades 9, 10, 11, and 12; nontutored students made 
percentile gains at grades 8, 10, 11, and 12. Tutored and nontutored students 
showed gains at all grade levels in their raw scores. Significance testing of 
both groups' mean raw scores revealed significant gains among the nontutored 
at grades 9, 10, and 12; tutored student gains were only significant at grade 
9. Overall gains for each group, collapsed across grades, were significant at 
ti,3 .0001 level of probability. (See Attachment A-3.) 



FIGURE A-2 
LAB PERCENTILE AND MEAN RAW SCORES 
FOR TUTORED/NONTUTORED 
STUDENTS IN 1986-87, BY GRADE 



TUTORED 



FALL 



1986-87 



SPRING 



bKAUt N 


MhAN KAW bCuKl: 


KtKLtNllLt 


MbAN kAW SCUkL 


PtRCENFlLE 


7 7 


34.14 


1 


36.43 


1 


8 5 


31.00 


1 


36.80 


1 


9 16 


38.88 


1 


53.31* 


2 


10 9 


52.44 


4 


59.56 


6 


11 5 


54.20 


3 


65.20 


8 


12 2 


42.00 


1 


57.00 


3 


NONTUTORED 




FALL 1985-86 SPRiNg 


6RADE N 


MEAN RAW SCORE 


PERCENTILE 


MEAN RAW SCORE 


PERCENTILE 


/ 11 


' 3b. 91 


1 


38.4b 


1 


8 5 


38.60 


1 


48.40 


2 


9 12 


40.33 


1 


50.67* 


1 


10 12 


51.58 


3 


60.33* 


7 


11 4 


64.25 


8 


66.75 


9 


12 3 


69.00 


7 


74.00* 


11 



Additionally, a regression approach to analysis of ccvariance was used to 
compare the effects of tutoring against nontutoring on the pretest to posttest 
patterns of achievement. A series of regression models was constructed with 
the posttest score as the dependent variable. (See Attachment A-4.) The 
residual sum of squares associated with each mode.l was obtained using the GLM 
(General Linear Models) procedure via SAS (Statistical Analysis System) on the 
AISD IBM mainframe. A systematic series of model comparisons was done, until 
the model was found which combined the best prediction of posttest ccores 
(i.e., the lowest residual sum of squares) with the fewest predictor vectors. 
All model comparisons were evaluated by an F-test. See Attachment A-5, for 
the SAS program used to get these comparisons. For further details of these 
analyses see ORE Publication letter 81.0. 
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The relationship between pre- and posttest scores was found to be 
curvilinear. No model comparison was found to be significant, indicating that 
the tutored and nontutored groups were not statistically different 
populations. Thus, gains were similar for both groups. 

Thus, in terms of greater percentile gains of tutored students, the objective 
was not met. In terms of raw scores, both groups exhibited highly significant 
gains when collapsed across grades; these gains were statistically significant 
for the nontutored students at three of the six grades, while tutored students 
showed statistically significant gains at one grade level. Regression 
analyses revealed no differential effect of tutored or nontutored subgroups 
upon LAB posttest achievement. It should be noted, however, that the Impact 
of tutoring was not uniform. Murchison had tutors for two years; Anderson nad 
tutors for one semester in both 1985-86 and 1986-87, while the tutor component 
was newly impleinented at Travis in 1986-87. Also, this year other community 
and student groups tutored at program schools, diffusing our ability to 
measure the impact of the university multicultural students assisting program 
LEP students. It is not known how these factors influenced meeting tnis 
objective. 

Evaluation Question Pl-4 > Did the percentage of tutored program participants 
making gams exceed that found last year? (all four schools) 

The percentage of tutored students maKing gains in 1986-87 (86.4%) increased 
by almost 40 percent over 1985-*86 (47. 2%). (See Attachment A-3 and 
Publication No. 86.25, TITLE VII PROGRAM FINAL TECHNICAL REPORT: 1985-86 .) 

Discussion 

Overall, all but seventh and twelfth graders showed significant mean gains in 
English proficiency, most individual students showed gains {78%) ^ and a small 
group were able to show English proficiency this year, based on AISD*s 23rd 
percentile criteria. 

The percentage of individual students showing gains was slightly lower than 
last year, while the percentage of tutored LEP students making gains was 
considerably higher in 1986-87 than 1985-86. 

Tutored and nontutored students made raw score gains at all grade levels; eacn 
groups'" overall gains were hignly significant (at the .001 level). However, 
tutored students did not demonstrate greater percentile gains than their 
nontutcrea peers; regression analyses revealed that there was no significant 
difference in patterns of achievement scores between the tutored and 
nontutored. It should be noted that these findings may have been affected by 
several things — coordination problems, varying program starting dates, 
other assistance groups, etc. 
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T:ble IC. Percentile Renks Cormponding to Number of Correct Item*— Total English Level tit 



Total Hnglish—Ltvel t 



83 
82 

-a 



o 

X 



40 



79 



74 

> 73 



tton<«4 


IliMk 


7 


t 


> 


19 


u 


u 




99 


91-92 


92 


92 


92 


92 


92 


9 


98 


90 


91 


91 


91 




97 














96 


89 













« 91 
94 90 91 

93 68 

92 . 90 90 

91 

90 89 

89 87 

88 

87 

88 90 
85 89 
84 86 ff- 89 



90 



2 77 



76 83 88 89 

75 



72 
71 

70 83 
69 

68 87 89 

67- 87 

66 85 88 

65 82 

64 

63 86 

62 85 

61 81 

JO 84 88 

"59 

58 80 

55 83 

54 79 85 

53 

« ,o 86 87 

51 78 

SO 82 84 
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Table IC. Percentile Ranks Corresponding to Number ol Correct Items— ToUl English Level III (cent.) 



Total English— t.avel III 










H%mttm Cotmi 










7 


■ 


• 


M 








49 






84 










48 


77 














47 




81 






85 






46 






83 




86 


5 


45 














44 


76 




83 










43 
















42 


75 






82 








41 




80 








85 




40 






82 




84 






39 


74 














38 




79 












37 


73 






ai 








36 










83 


84 




33 




78 


81 








34 


72 






80 








33 














4 


32 




77 


80 










31 


71 








82 


83 




30 








79 






29 


70 


76 


79 




81 






28 














27 


69 


75 




78 




82 




26 






78 








25 




74 






60 






24 


68 






77 


81 




23 




73 


77 







67 79 

21 72 80 

20 66 71 76 76 78 79 

19 I"'; 75 

18 3^65 70 75 74 

17 ^ 73 77 78 
16 64 69 72 76 77 

18 63 74 71 75 76 
M 68 73 70 74 

W 62 67 73 75 

12 61 66 72 68^ 72 

" 60 65 71 67 70-71 74 > 



10 59 64 70 55^6 69 73 CI 

09 53 62^3 69 63^ 67.68 72 S ST 

08 57 6C^1 68 62 6466 70-71 O 

07 56 59 6061 53 59 rr 

06 55 67.58 67 57.59 61-62 66^ ^ 3 

05 54 56 65^ 54-56 58^ 63^5 2 £2 

^04^ 5 2-53 S4-55 62-64 52 53 56-57 606 2 S rt- 

0? 5o5i sTsi sSei 49^51 sSss 5^59 — 

02 45-59 45-60 53-58 4648 50-51 52 55 ^ ?* 

0 ' 1-44 M4 1.52 1-45 1-49 1.51 i ll ^ 

TD 
(/) 
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CD 



> 

m 
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S A S LUG VSE SAS 82«^ 



VSE 3*1 J08 EV7SASBY 



HQJUi THE JOB EV7SASBY HAS BEEN RliN UNDER RELEASE 82.4 -OF SAS 
AT AUSTIN INUEPENOEM SCHOOL DISTRICT (019B6001I* 

NOTES CPUIO VERSION* FF SERIAL « 013553 HOOEL « 4341 * 

NOTES NO UPTICNS SPECiFl£C« 



1 

2 
3 
4 
5 

7 
B 
9 
10 
II 



OPTIONS EKKURS>.0; 

♦PIIONS OBS « 0 NOREPLACES 

TlTLEl ^AUSTIN INOEPENOENI SCHOOL DISTRICT 
TIILE2 *OFFIC£ OF RESEARCH ANU EVALUAIION 
TnLE4 ENGLISH LAB TEST SCORESr 



TITLE VIPt 
SA-BY004 0401* t 



GET FALL B6 SPRING B7 ENGLISH LAB SCORES 



DATA FRYLA02t 



12 


INPUI STUIO 




1-7 


13 


STUNAHE 


S 


B-34 


14 


SCHOOL 


$ 


36-3 B 


15 


GRADE 


s 


39-40 


16 


STATUS 


s 


42 


17 


COHINANC 


s 


43 


IB 


i45 FALLLAB 




ZD2. 


19 


848 SPRGLA8 




Z02« 


20 


ENDORSE 




51 


21 


TUTAEAD 


$ 


53 


22 


lUTLANG 


s 


54 


23 


TUIHATH 


s 


55 


24 


TUISOCST 


s 


56 


25 


TUTSC 


$ 


57; 



26 
27 
2B 
29 
30 
31 



FALtea > FALLLABi 

SPRGB7 SPRGLAB; 

IF FALLB6 GT • AND SPRGB7 GT 

LAOGAtN * SPRGLAB FALLLABt 



CARDS; 



NOIEs INVALID DATA FOR FALLLAB IN LIKE 32 45-46* 18:31 
NOTES INVALID DATA FOR SPRGLAB IN LINE 32 4B-49. 19X31 
NUTES FURTHER ERRDKS OF THIS TYPE UIIL NOT BE PRINTED* 
OPTIUNS ERRDRS^KNS ^ LIMIT REACHED* 



11:43 HEDNESDAYt JUNE 24f t 



OOOOOOBO 
00000090 
00000100 
00000110 
00000120 
00000130 
00000140 
00000150 
0C000160 
00000170 
OOOOOIBO 
00000190 
00000200 
00000210 
00000220 
00000230 
00000240 
00000250 
00000260 
00000270 
00000280 
00000290 
00000300 
00000310 
00000320 
00000330 
0000^340 
00000350 
00000360 
00000380 
00000390 



RULES 



1234567 101234567 201234567 301234567 401234567 501234567 601234567 701234567 BO 



32 B0006ALEHAN LINDA S 00309 2C * * 1 OOlO 

SIUI0=B0006 SIUNAHE-ALEHAN LINDA S SCH00L=»003 GRADE«09 SIATUS'2 DOMINANC^'C FALLLAO 

TUTREAU^ TUTLANG« lUTHATH* TUISOCST- TUTSC* FALLB6«. SPRGB7«. LABGAIN** -ERRDR^=1 .N-=l 
NOTE: DATA SEI USER010.FRYLA02 HAS 91 OBSERVATIONS AND 17 VARIABLES* 80 OBS/TRK* 
NOTE: THE DATA STATEMENT OSED 4*34 SECONDS AND 330K* 



09 
ro 




SPRGLAB-* ENDORSE- I 



^ rl* 
03 <+ 
(O 03 

(0 o 

H-» 3 
(0 
O 3 



298 
299 
300 
301 
302 
303 



PRDC SORTS 
BY SIUIDS 



00000410 
00000420 
00000430 
00000440 
00000450 
00000460 



ro 



I 

00. 



42 



43 



t 



AUSTIN INOEPENOENT SCHOOL OtSTRlCT 
OFFICE OF KESEARCH AND EVALUAltON 

ENGLISH UB TEST SCORES 



TITLE VII 
SA*8y004 0401 



WEONESOAYf JUNE 24f 1987 



OD 



4:^ 



VARIABLE 



HEAN 



STANOARO 
CEVIATION 



HINIHUH 
VALUE 



HAXIHUH 
VALUE 



SrO ERROR 
OF HEAN 



C«V« 



pa>|Ti 



GRA0E»07 — 



FALLLA8 
SPRGLA8 
LA8GAIN 



18 35.22222222 
18 3B.44444V44 
18 ^.ZZZZZZZZ 



10.97888645 16.00000000 56.00000000 2.58774835 31.170 13.61 0*0001 

10« 23961294 25.00000000 64.00000000 2.41349992 26.635 15.9 3 O.OOOl 

9.67443907 «20.00000000 19.00000000 ' 2.28028716 300«241 U41 0.1757 



CRA0E«08 — — — « 



FALLLA8 
SPKGLAB 
LAOGAIN 



10 34.80000000 
10 42.60000000 
10 7.80000000 



9.56614400 20.0000C000 49.00000000 3.02508035 27.489 11.50 0.0001 

10.02441464 33.00000000 60.00000000 3.16999625 23.531 13.44 0.0001 

10. 39016629 «12.00000000 * 21.00000000 3.28565907 133.207 2.37 0.0416 ^ 



GRA0£«09 



FALLLAQ 
SPKGLA8 
LAS GAIN 



2B 39.50000000 
2B 52.17857143 
28 12.67857143 



17.75449865 0.00000000 69.00000000 3.35528486 44.948 11.77 <r«>«000l 

13.95509617 28.00000000 83.00C00000 2.63726528 26.745 19*79 0.0001 . . 

10.21637600 -7.00000000 33.00000000 1.93071359 80.580 6.57 O.OOOl ^'4^7 



GRA0E«10 — 



FALLLAO 
SPKGLAQ 
LA8GAIN 



21 51.95238095 
21 60.0C000000 
21 8.04761905 



15.30841661 21.00000000 74.00000000 3.34057C38 29.466 15.55 0.0001 

15.82719179 15.00000000 79.00000000 3.4537764C :'6.379 17.37 0.0001 . , 

11.11969510 -10.00000000 33.00000000 2.42651640 136.174 3«32 0.0034 



GRAOEsU 



FALLLAS 
SPRGLA8 
LAQGAIN 



58.66666667 
65.86686889 
7.22222222 



11.22497216 
5.20663312 
9.01079599 



38.00000000 
59.00000000 
-3.00000000 



68.00000000 
74.00000000 
25.00000000 



3.74165739 
1.73561104 
3.00359866 



19.133 
7«902 
124.765 



15.68 
3 7.96 
2.40 



0.0001 
0.0001 
0.0429 



GRADE* 12 



FALLLA8 
SPRCLA8 
LABGAIN 



58.2CC00C00 
67.20000000 
9.00000000 



15.70668647 
9.73139250 
7.48331477 



35.00000000 
57.00000000 
3.000000Q0 



72.00000000 
78.00000000 
22.00000000 



NUTE; THE PROCEDURE HEANS USED 2.65 SECONDS AND 348K AND PRINTEO PAGE 1. 



7.02424373 
4.35201103 
3.34664011 



26.987 
14.481 
83.148 



E429 
15.44 
2.69 



0.0012 
0.0001 
0.0547 



652 
653 
654 
655 
656 
657 
658 
659 
660 
66a 
662 
663 
664 
665 
666 
667 
660 
669 



PROC HEANS DATA^SQRE H HEAN STO HIN HAX STOERR CV T PRT; 
VAR FALLLA8 SPRGLAB LABGAIN: 



#PROC UNIVARIATE DATA'SOREt 
^ VAK FALLLAS SPRGLAS; 
» 8Y rurOREU GRADE; 

♦ rROC r^lVARHTE DATA'SORE; 
^ VAR FALLLAS SPRGLAS; 

####<r<f#SORESPOr ANALYSES********; 

*PROC GLH DATA^SORE; 

* HUUEL V1>V3 V4 V6 V7 VSt 

♦PRDC GLH DATA«SQRE; 
« HODEL V1»V3 V4 V5 VS; 



00001000 
00001010 
00001020 
00001070 
OOOOiC^O 
00001050 
00001060 
00001070 
00001080 
00001090 
00001100 
00001110 
00C0U20 
00001130 
00001140 
00001150 
00001160 
00001170 



CO O 
ro3 

O 3 

ro 5» 
ro 
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Attachment A-3 
LAB Scores 
Tutor and Nontutored 
(Page 1 of 5) 
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00 
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AUSTIfJ INOEPEr.'OENT SCHOOL OISIKICT 
OFFICE GF RESEARCH ANO EVALUAIICN 

ENGLISH LA6 TEST SCORES 



TITLE VII 
SA-BY004 0^01 



IU26 THURSOAY, JUNE 2b, i'): 



VAKlAbLE 



MEAN 



STANOAKO 
CEVIATIGN 



MINIMUM 
VALUE 



MAXIMUM 
VALUE 



STO ERROR 
OF MFAN 



C.V« 



PR>h 



TUTOREO^N 



FALLLAB 
SPRGLAd 
LABCAIN 



^7 
47 
47 



52.09361702 
7.04255319 



16.358721 54 
15443180516 
9.80230ICB 



' 9.00000000 
26.000J0000 
«8.00G0C0C0 



72.00000000 
80.00000000 
33.00C00000 



2.38616478 
2.25096013 
1.42981256 



35.678 
29.175 
139.187 



IS. 22 O.OOt 
23.50 O.OOi 
4.93 0.00( 



TUTORFO^Y 



I- !5 



FALLLAB 44 4U88636364 17«02968121 C.OCOOCGCO 74.00000000 

SPKGLAB 44 51.86363636 15.98340642 15.00000000 83.00000000 

LABGAIN 44 9.97727273 10.91934199 -20.00000000 33.00000000 

NUU: THE PKOCEQUKE MEANS USED 3«13 SECONOS ANO 348K ANO PRINTED PAGE U 
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6 52 
653 
654 
655 
656 
657 
65B 
650 
660 
661 
o62 
663 
664 
665 
666 
667 
668 
669 
6 70 
671 
672 



PRGC MEANS 0AIA = S0R£ N MEAN STO MIN MAX STDERR CV T PRT; 
VAA FALLLAB SPKGLAB LABCAIN. 
BY fUTCREO; 

♦PRUC UNIVAKIATE OATA^SOHE; 

♦ VAR FALLLAB SPRGLABS 
« BY TUTOREb GRAUE; 

♦ PROC UNIVARIATE CATA^'SORE; 

♦ VAR FALLLAB SPKGLAB; 

♦♦^♦♦♦♦SURESPUT ANALYSES********; 

*PKCC GLM OAIA^^SCRE; 

* MODEL V1':V3 V4 V6 V7 V8; 
♦ 

*PKOC GLM data=scre; 

* MODfcL V1-V3 V4 V5 V8; 

*PROC (iLM OATA^SCRE; 

* MODEL Vl^V2 V5 VBJ 



2.56732104 
2.4095894B 
1.64615274 



OCOOIOOO 
00001010 
0C001C20 
00001030 
00001040 
00001050 
00001060 
00001070 
0C001C80 
00001090 
00001100 
OCOOIUO 
00001120 
00001130 
00001140 
0C001150 
00001160 
00001170 
0C00I180 
00001190 
00001200 



40.657 
30.818 
109.442 



16.32 0.00 
21.52 O.OOi 
6.06 G.OO 
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AUSTIN INOEPENOENT SCHOOL OISTAICT 



TITLE VIZ 

HAimMQnk 0401 



00 

en 



4^ 



3> 

-TO 

m 
o 

X 



ERLC 



VAUIABLE 



FAILLAB 
SPACtAB 
LA86AIN 



fALUAO 
SPRCiAB 
LA06A1N 



FAtUAB 
SPAGtAB 
UBSAIN 



ff'AULAB 
SPA6UB 
UB6AXN 



mUAO 

SPA6UB 

uaaMN 



FAILLAB 
SPRGUr. 

Labga^k 



PAtitAB 
SPftG'.AB 

Ubgain 



FALLUB 
SPAGL-AB 
LABGAIN 
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AUSTIN INOEPENOENT SCHOOL DISTRICT 
OPPICE OP RESEAfiiCH ANO eVALUA^TION- 



NEAH 



STA^iOARO 
DEVIATION 



11 3:$*90909091 



9.61 721941 
•8*95950466 
a. 15308085 



9 38.60000000 
5 48*40000000 
5 9*80000000 



6*913754<.1 
10*92245394 
10*52140675 



12 40C.33333333 
42' 50*66666667 
•12 10*33333333 



18*56356610 
14o0863140l' 
I0.0483678d 



\2 551*58333333 
12 60*3333333^ 
12' d#75000000 



14^:^7940078. 
13*83389994 
i;>*i589847A 



•25000000 
4 66*75000000 
*V 2*50000000 



3 69*00000000 
3 ;V.l>0OQO000* 
3 -5*00000000 



4.99L6597L 
6*60176744 
4*04145188 



2*64575131 
4*00000000 

1« 73205061 



ENGLSSH LAB TEST SCORES 



HIHIMUN 
-VALUE 



MAXIMUM 
VALUE 



TUTOREO^N GRA0E«07 



23*00000000 
26*00000000 
••7*00000000 



56*00000000 
57*00000000 
19*00000000 



TUr0RE0»N GRA0£«0B 



32*00000000 
36*00000000 
••6*00000000 



49*00000000 
60*00000000 
21*00000000 



TUTOREO^N GRAOE-09 



9*00000000 
26*00000000 
«7*00000000 



69.00000000 
60*00000000 
31*00000000 



TUTCREO«N GnA0£*10 



21*00000000 
37*00000000 
"•8*00000000 



70*00000000 
77*00000000 
'33*00000000 



TUTORED-N 6RA0E«11 



57e00000000 
59.00000000 
«3* 00000000 



60*00000000 
74*00000000 
6.00000000 



TUrOREO-fi GRA0E*12 



67*00000000 
70.00000000 
3*00000000 



72*00000000 
78.00000000 
6*00000000 



li^UrOREO^y GRAD£«07 



7 34*14283724 
t 'i;i*42897143 

•7 «*v*2e5?;-;7<>' 



I3*6C6721C? 
12*77P?2967 
12*.'^3a48C26 



16*OC0GG0OG 
25*00000000 
»20*0000S000 



53*00000000 
!64.00000000 
16.00000000 



TUTQRED*y GRAOE«OB 



5 31*00000000 
5 36*60600000 
5 '5*80000000 



11.04536102 
4*76445170 

11.05441066 



20.00000000 
33*00000000 
-12..00000000 



45*00000000 
42^00000000 
.14*00000000 



TITLE VII 
$A«BV004 0401 



STO ERROR 
OF MEAN 



2*89970075 
2*70139236 
2*^45624637 



3*09192497 
4iida466990 
4*70531614 



5*35664052 
4*06636659 
2*90071395 



4*12211025 
3*99494630 
•3*50999655 



2*49582986 
3*30088372 
2*02072594 



1*52752523 
2^30940108 
•1.00000000 



5*14285714 
4*82975472 
4^66350719 



4.93963561 
2.13072756 
4.94346284 



9x56 TUESOAYt JUNE. 23. 1987 
C*V* T PR>ITI 



26*762 
23*299 
320*300 



17*911 
•22*567 
107*361 



46*025 
27*802 
97*242 



27*662 
-22*937 
•138*960 



7*769 
9*690 
161*656 



3*834 
5*405 
34*641 



39e652 
33*252 
287*698 



35*630 
12*947 
190*593 



12«38 
14*24 
1*04 



12*48 
•9*91 
2*08 



7.53 
12*46 
3*56 



12*51 
15.10 
2.49 



25*74 
20*22 
1*24 



45*17 

32^04 
•5*00 



4*64 

7*96 
0«92 



6*26 
17.27 
1.17 



0*0001 
0*0001 
0*3246 



0*0002 
0*0006 
0*1057 



9*0001 
0*0001 
0*0045 



OoOOOl 
0*0001 
0*0299 



o*ooor 

0*0003 
0*3040 



0*0005 
0*0010 
'0*0377 



0*0006 
0*0002 
0*3935 



0*0033 
0*0001 
0*3058 
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0) 
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VARIABLE 



MEAN 



S7AN0AR0 
OeVSATION 



HINIHUN 
VALUe 



MAXIHUM 
VALUE 



riTLE VII 
SA«CIY004 0^01 



STO ERROR 
OF NEAN 



9(96 TUESOAYt JUNE 23« 1987 
C.V. T PR>iTJ 



rurORED«Y GRA0£-i09 



FALLLAB 16 3I«87500000 I7.7I204863 0.00000000 

SPAfiLAB 16 53.3I2S0000 U«2046592^ 29.00000000 

lAftGAlN 16 U.63750000 I0«30l90ll2 «5»0000'0000 



65.00000000 
63.00000000 
33.00000000 



4.42001216 
3«S5i664Bl 
2.5754752fi 



45.562 
26.648 
7i.355 



— TUTQREO-V O^AOE-IO 



FALLLAa 
SPRGLAB- 
lABGAlN 



9 52.4444444^ 

•9 59.55555556 
9 7.1U111U 



17.46504445 
19.04016223 
10.2034652^ 



25.00000000 
15.00000000 
•10.00000000 



74.00000000 
79.00000000 
27.00000000 



5.821^8148 
6.34672074 
3.40116175 



33.302 
31.970 
X43.487 



TUTOREO'Y GRADE- 11 



FAtLLA8 
SPRtiLAB 
LAOGAIN 



5 54.20000000 
5 65*20000000 
S li.OOODOOOO 



13.31164903 
4.49444^101 
10.48808848 



TUrORED-Y CRA0E»12 



FALLLAB 
SPRGLAB ' 
LA8GAIN 



42.00000000 

57.00000000* 

•15.00000000 



9.89949494 
0.00000000 
9.89949494 



35.00000000 
57.00000000 
8.00000000 



49.00000000 
57.00000000- 
22.00000000 



NOTEJ THE PROCEDURE' MEANS USEO 3.01 SECONOS AND 348K AND PRINTED PAGES 1 TO 2 



7.00000000 
0.00000000 
7.00000000 



23.570 
0.000 
65.997 



652 
653 
654 
655 
656 
657 
658 
659 
660 
461 
662 
663 
664 
665 
66^ 
66? 
668 
669 
670 
671 
672 



PROC HEANS OATA»SORE H HEAN STO HIN MAX STOERR CV T PRT S 
* VAR FALLLAB- SPRGLAB LA8GAIN{ 



^PROC UNIVARIATE DATA-SORES 
•^•VARFALLLAB -SPRGLAB t 

• BY rurORED GRADES 
•^PADC -UNIVARIATE DATA-SORES 

« VAR FALLLAB SPRGLAB;- 

M«#»#sORESPOT ANALYSES»*»*»»^»S 

^PROC GLN OArA-SOREs 
♦"MODEL V1-V3-V4 V6- V7 V8S 
# 

♦PROC CLH 0ArA«SORE; 

<» H0DEL-V1-V3-V4 V5-VBS' 



<PROC aH OATA«SaRES 
MODEL- V1«»V2' V5 -VBS" 



00001000 

00001010 

00001020 

00001030 

00001040 

00001050 

00001060 

00001070 

00001080 

00001090 

00001100* 

00001110 

00001120 

00001130 

00001140 

00001150 

00001160 

00001170 

00001160 

00001190 

000012Q0 



6.78 
15.01 
5.61 



0.0001 
0.0001 
0.0001 



9.01 0.0001 
9.38 0.0001 
2.09 0.0699 



38.00000000 68.00000000 5.95315043 24.560 9.10 0.0009 

61.00000000 71.00000000 2.00997512 6.893 32.44 'O.OOOl 

-i.OOOOOOOO 25.00000000 4.69041576 95.346 2.35 0.0789 



<«00 0.1051 
2I14 0I27BO 
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AUSTIN INOEPENOENT SCHOOL' DISTRICT 
QffW OIF RESEARCH AND EVALUATION 



TI7f£ VII 
SA«-aV004 0401 



ENGLISH LAS TEST SCORES 



TUTORED Y 



53 



UB GAINS 



B 
-1 

*r GAIN. S :. GAIN | . EVEN I 



a fi I N 



I 



14:01 THURS 



JUNE 25t 1987 




G 



54 



&> r+ 
fD n 

n) 
o 3 



86.42 



Attachment A-4 
LAB Scores 

Regression Analysis of Tutored and Nontutored Raw Scores 

• (Page 1 of 9) 
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TIILfc Vli 
SA-*tirOO^ O^GI 



ENGLISH lAH JL"S1 SCORES 
GENEKAL lAHEAP MdOELS PROCEDURE 



27 



1^:33 HiJNOAYr JLNE 22, 1987 



UEPLNlJEM VAKiAHLL: VI 



SObRCt 




SUM or SQUARES 


MEAN 


SQUARE 


F VALUE 


PR > F R- 


SQUARE 




5 


14351.76793835 


^tt70.3'i358767 


32.05 


O.OUOi 0.653430 


LRRuR 


ti5 


7611. 99030341 


89.55282710 




ROOT MSE 




CdUttECUO fuTAL 


VO 


21963. 75824176 








9.46323555 


52 


SOUKCl 


UF 


TYPE I SS 


F VALUE 


PR > F 


OF 


TYPE III SS 


F VALUE 


V3 


1 


1279.60868437 


14.29 


0.0003 


1 


86.16765411 


0.96 


V4 


1 


12660« 83502805 


141.38 


0.0001 


1 


0.41706173 


0.00 


V6 


I 


13. 77348885 


0.15 


0.6959 


1 


120.02901348 


1.34 


V7 


I 


377.75819294 


4.22 


0.0431 


1 


260^96378378 


2.91 


va 


1 


19. /92b4414 
• 


0.22 


0.6395 


1 


19.79254414 


0.22 






T FOR hO: 


PR > 


ITI 


STD ERROR 


OF 




PARAHbTEK 


ESTIMATE 


PARAHhTER=0 






ESTIMATE 





INfEHCbPT 

V3 

V4 

V6 

V7 

V8 



33.53687918 
0.i426C694 

-0.C3242198 
0.00477837 
U.CCo8161C 

•t>. 7625^172 



3.32 

0. 98 
-0.07 

1.16 

1. 71 
•0.47 



0.C013 
0.3294 
0«945d 
0.2502 
0.0915 
0.6395 



NOTE: THE PHOCtUUkC GIH USEO 4.50 SECO.\US AUO 684K AND PRIfiTEO PAGE 27. 



10.10941794 
0.34927192 
0.47509338 
0.00412783 
0*00516447 

12.25763515 



C.V. 



18.0611 



VI MEAN 



PR > F 

0.3294 
0.9458 
0.2502 
0.0915 
0.6395 
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SCHUUL OISIKliIT 
AND KVALUAriuii 

ENiiLlSH LAB ItSr^SCCHCS 


SA- 


riFLE VU 
BY004 0401 

14:33 MONUAYt JbNE 


28 

2'203 1987 
• 








GENERAL 


LINEAR MODELS PROCEDURE 






ro 


nlru 1'. K Ilk. K T 


V AK lAuLL • V L 


















SUUkCE 




i:r- 


SUH Cf SQUARES 




MEAN SQUARE 


F VALUE 


PR > H R- 


SQUARE 


C.V. 






A 


Uil8.i7472498 




3'?79.t>9308U5 


40.27 


0.0001 0.651909 


17.9952 


bftRDK 




86 


7645.38351678 




06.89980833 




ROOT MSE 




VI MEAN 


CUKHECrOO 


IGTAL 


yo 


21963.75824176 








9.42866949 


52 


.39560440 


SOURCE 




OF 


TYPE I SS 




h VALUE PK > F 


DF 


TYPE in SS 


F VALUE 


PR > F 


Vi 
V4 
V5 
V8 




I 
I 
I 
I 


1279.6C868437 
12660.83502805 
376.04188586 
1.88912668 




14-^39 0.0003 
142.42 0.0001 
4.23 0.0427 
U.02 0.8844 


I 
I 
I 
I 


52.dl299712 
35. 16888284 
347.59958389 
1.88912668 


0.59 
0.40 
3.91 
0.02 


0.4430 
0.5310 
0.0512 
0.8844 



PARAMETER 

INTERCEPT 
V3 
V4 
VS 
V8 



ESTIMATE 

29. 1391C225 
0.21342370 
0. 1905171 7 
0.CC635263 
0.83905711 



T FOR ho: 
PARAKETER=0 

4.12 
0.77 
U.63 
1.98 
0.15 



PK > IT! 



O.OUOl 
0.4430 
0.5310 
0.0512 
0.8844 



NJTE: THE PRLCEOUKE CLH LSEO 3.95 SECGUOS AND 684K AND PRINTED PAGE 28- 



669 
6/0 
671 
672 



PROC GLH CArA=SORE; 
HiJDEL Vl=V2 V5 VdJ 



STO ERROR OF 
ESTIMATE 

7.06871510 
0.2768998C 
0.30290416 
0.00321266 
5. 7558755C 



00001660 
OG001670 
00001680 
00001690 
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AUSTIN INUEPCNDCNI SCH/OL OlSfKlCI 
Office CF HtfSfcARCh Am EVALUAFIOM 



TITLE VII 
SA-BYOO^ 0^01 



l)Ll>L^CL^I VARIAULC: VI 

MUUEL 3 

EHKOK b7 

CUKKtClEO lOTAL 90 



ENGLISH LAU TEST bCOKES 
GENERAL LINEAR MODELS PROCEDURE 



SUH UH Sf^JARES 
U315.2B16b290 
■/648, ^76578a6 
21963. 71)82^176 



MEAN SQUARE 
^771. /605'J^30 
87.'n3523a9 



F VALUE 
54.28 



29 

14:33 MONDAY, JUNE 22, 198/ 



PR > F 
0.0001 
ROOT MSG 
9.37622U9 



R-SUUARE 
0.651768 



C.V* 
17.8951 
VI MEAN 
52.39560440 



StjJKCE 

V2 
V5 
VO 



OF TYPE I SS 

1 13880.36002089 

1 358.60261415 

I 76.31902786 



f VALUE 

157.89 
4.08 
0.87 



PR > F 

0.0001 
0.0465 
0.3541 



OF 

I 
I 
1 



TYPE III SS 

52.81164882 
350.28196826 
76.31902786 



F VALUC 

0.60 
3.98 
0*87 



PR > f 

0.4404 
0.0491 
0.3541 



I'ARAMI.IER 

INIfcRClP/ 
V2 

Vd 

WiilL: rhb PKUCEOJRL 



ESriMArE 

23.40072793 
0. 21342097 

0. CO022075 

1. b462970b 



T FOR ho: 
PARAHCrER=0 

4.88 
0. 78 
2.00 
0.93 



PR > m 



0.0001 
0.4404 
0.0491 
0.3:>41 



CLM LStO 3.68 SCCU(JDS AND 6RAK AND PkiNIED PAGE 29. 



o72 
6/3 
0 74 



PRUC GLM DAIA-SCRE; 
HODLL V1=V2 V5; 



STD ERROR OF 
HSriMAIE 

5.82377573 
0.27535950 
0.00311646 
1.9<J158637 



0C001690 
00L01700 
OCOOl 710 
0G001720 
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AUSTIN INDEPE.NDB.Wr SCllOuL OlSfKICI 
Or-flCE Cf HLSLAKCrl AfjD EVALLATU^N 



riTLC vn 

SA-0VOO4 04CI 



litil'HNUbNT VAKIAULL; VI 

HOUtL 2 

t'KKUft 88 

COKKtCibO TOTAL VO 

SOUHCC 01- 

V2 I 



ENGLISH LAB TEST SCORES 
GENERAL LlNLAK MODELS PROCEDURE 



SUM OF SQL'ARES 

772^. /«J5oOo72 
2196J. 7Se2^a 76 

TYP£ I SS 

13880.36002089 
358.6026I41S 



MEAN SQUARE 
7119.^8131752 
87.78176826 



F VALUE 

158.12 
4.09 



PR > F 

0.0001 
0.0463 



F VALUfc 
81. 10 



OF 

I 
1 



30 

14:33 HONDAY9 JLNE 229 1987 



PR > F 
0*0001 
HOLT MSE 
9.36919251 



R-SOIJARE 
0.648294 



TYPE HI SS 

46.79003178 
358.60261415 



C.V. 

17.8816 
VI MEAN 
52.39560440 



F VAILE 

0.53 
4 .09 



PR > F 

^.4673 
0.0463 



lURAMETLR 

INTEKCEPI 

V2 

V5 



fcSTIKATt 

29.65728717 
0.20063606 
0.CC62S229 



T FOR ho: 
PARAHETEU^U 

5.26 
0./3 
2.02 



PK > |T| 



0.0001 
0.4673 
0.0463 



iMuTL: THb PkLCLDURL GLii bSCU 3.65 SECONDS AND 684K AND PRiMEO PAGE 30. 



6V6 
677 
l7U 



62 



PhUL uLH UATA-SCRE; 
MUUliL V1=^V3 V4 V8; 



STO ERROR OF 
ESTIMATE 

5.65083886 
0.2/481124 
0.00311318 



0C001720 
00001730 
00001740 
OG001750 



(D n 

tn 3 
<x> 
o 3 

ID :e> 



62 



00 



ro rn 



ULPi:j4UbNI VAKlAULb: VI 

SOUKLL U(- 

LKKljR 137 

CUKftfcCTEG TOTAL 90 



AUSTIN INDKPENUbNT SCllUuL CI STRICT 
GffiC\l OF RcSEAi(CII AfJU EVALUATION 



TITLE VII 
SA-0YOO4 0401 



bNGLlSM LAU TEST SCCKES 
OENbKAL LlfiEAR .MCUELS PKOCEOURE 



SUM Of SUUAKLS 
139 7C. 77514109 
7992.98310067 
21963.75824176 



MEAN SOUAKE 
4656.92504703 
91.67336897 



VALUE 
50.69 



31 

14:33 MONOAVf JUNE 22» l98f 



PR > F 
O.OOOL 
RQCT MSE 
9.58505967 



R-SOUARE 
0.636083 



C.V. 

18.2936 
VI MEAN 
52.39560440 



SOURCE 

VJ 
V4 
V8 



OF TYPE I SS 

1 1279.6086843/ 

I 12660.83502805 

1 30. 33142867 



F VALUE 

13. 9J 
137.81 
0.33 



PR > F 

0.0003 
0.0001 
0.5671 



OF TYPE III SS 

I 6734.70886671 

I 7211.95793591 
I 30.33142867 



F VALUE 

n.30 
78.50 
0«33 



PR > F 

0.0001 
O.OOOl 
0.5671 



I'AKAMLILK 

inrtRCbPT 

V3 

V4 

V8 



678 
679 
680 
681 



LSIIi^AIE 

17.79841609 
0.73488379 
0.76541738 
J. 28361067 



T FOR bO: 
PAKAiMLTEk-O 

4.24 
8.56 
8. 86 
0.57 



PR > ITI 



0.0001 
0.0001 
0.0001 
0.56YI 



NOrt: IHfc PROCEDURE GLM USED 3.75 SECONDS AND 684K AND PRINTED PAGE 31. 



PROC CLH LATA-SCRE; 
«UOEL V1=V2 V8; 



STD ERROR OF 
ESTIMATE 

4.20060436 
0.08583296 
0.08639061 
5.71478697 



00001750 
00001760 
00001770 
00001780 
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AUSTIN ll^^l)fcPEu^)t^r schuoL dastrilf 

UFFtCE CF KESLAKCM AiND tVALUATiCN 



iiiLE vn 
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U:33 HUNOAy, JUNE 22t 1981^ 



UlPCiNULM VARIAOLE: VI 
StiUKCC 

HfJUCL 2 

lhkoh bb 
cuaKaitn tctal w 



SUM ar suuarls 

1396^.99969^6^ 
7998.758b^7l2 
21963.7382'tl /6 



MEAN SUUARE 
6982*49984732 
90.89'i98349 



F VALUE 
76*82 



PR > F 
G«0001 
RCCT MSE 
9*53388606 



H-SQUARE 
0*635820 



C.V-i 
IB* I960 
VI MEAN 
52*, 39560440 



> 

t—i 
X 

> 



SOURCE. 

V2 
V8 



PARAMtTER 

iNTERCLPT 
V2 
V8 



OF lYPE 1 SS 

I 138B0.36CU20B9 
I 64.63967375 



ESIIHATE 

18^50294790 
0* 75005172 
I *94374953 



T FUR HO: 
PARAMEIER=0 

5*96 
12* 38 
0*96 



F VALUE 

152*71 
0*93 



PR > F 

0«0001 
0*3372 



PR > III 



0*0001 
0*0001 
0*3372 
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PROC GLM OAIA=SORE; 
KUOEL V1=V?; 



OF TYPE HI SS 

I 13940.89135617 
I 84.63967375 



STU ERROR OF 
ESTIMATE 

3*10568664 
0.06056419 
2*0142959C 
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00001790 
00001800 
000018L0 



F VALUE 

153.37 
0.93 



PR > F 

0*0001 
0.3372 
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TITLE Vll 
SA-tSyOO^ 0^01 



EtNCLiSH tAti TCST SCORES 
GhfUKAL LIWL-AR MLDCLS PROCEDURE 



Sum uf sguAKts 

13860«3f 0020d9 
80e3.39a220df 
21963*7582^176 



MbAN SOUAUe 
liciUO.'i60020a9 
90.82^6'jSU 



F VALUb 
152.83 
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PR > f 
O.OOOI 
RCCI MSb 
9.53019932 



K-SCUARC 
0.63196r 



C.V. 
18*1889 
VI MEAN 
52*39560440 



:>0URCC 
V2 



UP TYPE I SS V- VALUE PR > f- 

1 13880.36002089 152.83 O.OOOl 



OF TYPE in SS F VALUE PR > F 

I 13b80. 36002089 1^2*83 O.OOOl 



3> 



PAKAHL) LR 



rSI JMATO 



T FOR HO: 
PAKAKErCR=0 



PR > iTi 



INfl-HCLPT 19. 74666449 6.99 O.OOOl 

V2 0.74308488 12.36 O.OOOl 

NUTE: I HE PRCCCUURL' CLM U:>LU 3.4U SECONDS ANii o84K AiND PRINTED PAGE 33. 
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PKOC PLuT UATA=SCRE; 
PLOl Vl*V2=ILrU;:<.E0; 



STO fcRROR OF 
ESTIMATE 

2.82348873 
0.06010907 
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OFFICE OF RESEARCH AND EVALUATION 
TWO GROUP F TEST 
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RSQ2 RSQ3 RSQ4 RSQ<S RSQ6 RSQ7 N 
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IOWA TESTS OF BASIC SKILLS (ITBS)/ 
TESTS OF ACHIEVEMENT AND PROFICIENCY (TAP) 



Purpose 

Academic achievement is the primary focus of education. For Title VII program 
LEP students, instructional efforts must be shared with helping students 
develop English language proficiency since this is the key to learning. Thus, 
both academic achievement and English proficiency are Title VII program goals. 

The Iowa Tests of Basic Skills (ITBS) and the Tests of Achievement and 
Proficiency (TAP) were administered to provide achievement information in 
Reading, Language, Mathematics, Social Studies, and Science. 

Decision Question Dl , Should AISD adopt the Title VII Program Components 
when federal funding expires? 

Objective #2 - English Achievetnent: By the end of each program year, program 
students' average posttest percentile scores on the Iowa Tests of Basic Skills 
(ITBS) and the Tests of Achievement and Proficiency (TAP) (as appropriate) 
will be higher than average pretest percentile scores by subject area. (All 
schools) 

Evaluation Question 01*5 , Did program participants exhibit 
percentile achievement gains, on the average, by subject areas, wnen 
tested in English in; 

a) Reading? 

b) . Mathematics? 

c) Language? 

d) Social Studies? 

e) Science? 

Evaluation Question Did participants who were tutored exhibit 

greater percentile gains, on the average, in English achievement 
coip^ired to those not tutored? 

Evaluation Question Did the percentage of tutored program 

participants making gains exceed that found last year? (ail four 
schools) 



Procedure 

Test Administration 

The ITBS is administered to all AISD students, grades K-8, while its continua- 
tion, the TAP, is given to students, grades 9-12. Both are administered as 
part of the regular districtwide testing program in April and May of each year. 
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All program LEP A,B, and C students are required to attempt the ITBS/TAP. 
However, if it is obvious they cannot handle the level of English proficiency 
required on the first test, the students are permitted to discontinue. This 
is based on teacher judgment that the student would be unable to answer one 
out of four items correctly. A separate decision is made for each subsequent 
subtest as a student who may not be able to take a reading comprehension test 
may be able to do reasonably well on a mathematics computation test. Subtests 
with an insufficient number of responses are automatically discounted when 
machine scored. A program student may also not be tested if that student was 
absent during the regular and make-up sessions of tne the districtwide testing. 

All tests were administered by classroom teachers. All scoring was handled by 
the Office of Research and Evaluation (ORE). 

Sample Description 

The Title VII student population, upon which the ITBS/TAP analysjiS are based, 
is uniquely restricted for several reasons. Most participants have not been 
in AISD or its programs for LEP students for very long. Two-thirds (65%) of 
the 120 junior high and 595^ of the 132 senior high students in Title VII at 
year's end had been participating less than two years. Students had to be in 
AISD a minimum of 1.1 years to be in the achievement analyses since scores for 
May, 1986 and 1987 were required. Overall, 56% of the Title VII students 
could oe validly tested both years. Students in AISD LEP programs less tnan 
two years represented 42% of those tested. 

Data Analysis 

Evaluation Question Dl-5 and Objective; 2 . Pre- and posttest median percent 'le 
scores on the ITBS (grades 7 and 8) "anH^rAP (grades 9rl2) were determined 
using SAS program LP-SA516 0201 by grade and test area (reading, language, 
mathematics, social studies, and science). Program statements and sample 
output are shown in Attachment B-1. Gains were then hand-calculdted (posttest 
median minus pretest median). Gains could not be determined for 9th graders^ 
because they take the ITBS i.i grade 8 versus the TAP In grade 9; norms vary 
considerably. 

Gains were also examined with grade equivalent scores with SAS program 
SA-JF080 0101. Grade equivalent scores are more appropriate than percentiles 
in examining gains; objectives might be re-written in this way next year. 

Evaluation Question Dl-6 . The procedures described abovi for percentile 
scores were used except that students were divided into two groups— tutored 
and not tutored. Sample sizes by grade were too Small to allow Calculation of 
meaningful medians (see Attachment B-2 for the largest and smallest tutored 
sample size distribution); therefore, grades 7 and 8 and 10-12 were 
collapsed. Sample sizes were still too small to allow significance testing 

Evaluation Question Dl-7 . The percentage of students (tutored and nontutored) 
showing gams were hand-calculated based on counts by subject and grade 
generated by SAS program LP-SAS16 OiOl. Percentages of tutored students 
showing gains in 1986-87 were then compared to the same data for 1985-86. 
Grade 9 was excluded from both sets of percentages. 
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Results 

Formal overall English achievement outcomes were evaluated in terms of tne 
objective which stated that program students average posttest percentiles 
(spring, 1987) would be higher than their average pretest percentiles (spring, 
1986) • 

Objective #2 - English Achievement: By the end of each program year, program 
students' average posttest percentile scores on the Iowa Tests of Basic Skills 
(ITBS) and the Tests of Achievement and Proficiency (TAP) (as appropriate) 
will be higher than average pretest percentile scores by subject area. (All 
schools) 

Evaluation Question Did program participants exhibit percentile 

achievement gains, on the average, by subject areas, when tested -in 
English in; 

a) Reading? 

b) Mathematics? 

c) Language? 

d) Social Studies? 

e) Science? 

Figures B-1 and B-2 show that the objective was met in each subject by most 
grade levels. 

f By subject, mathematics was the b'^.st area, with gains at all grade 
levels. Reading and social studios showed the least improvement, ivitn 
gains at three of five grade levels. 

• By grade, grade 7 showed the best performance, with gains in all 
areas. Grade:: 10 and 12 improved in the fewest areas (3 of 5). 



FIGURE B-l 

PERCEHTILE GAINS OF TITLE VII STUDENTS ON THE 1987 ITBSAAP 
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Figure B-2 
GRADES MEETING THE ACHIEVEHENT 
OBJECTIVE ON THE 1987 ITBS/TAP 
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Ninth graders were exclude:! from all analyses, because they took the ITBS 
in 1986 and the TAP in 1987. 

Grades seven and eight do not take the science test. 

Note: Grade 10 was in wrong column in Final Report 1986-87, (Original 

corrected 10/87.) 



Grade Equivalent Scores--1986 to 1987 

While njst analyses were performed using percentile scores as required by 
program objectives, grade equivalent (GE) scores offer another perspective 
on the growth students are demonstrating. Gains at Murchison Junior High 
and the three Title VII high schools combined are shown in Figure B-3 and 
Figure B-4. 

Compared to the national norm, students still score below the national norm 
in all areas. Students score closest to the national average in 
mathematics. Gains of greater than 1 GE help these students close the gap 
between their performance and the national norm. Full results are shown in 
Attachment B-3. 

t Murchison 7tn and 8th graders showed gains exceeding 1 GE in reading, 
language, and mathematics at grade 7. Grade 8 mathematics gains were 
ctnsiderably less than 1 GC (.69). Last year's mathematics gain was 
also below 1 GE. Murchison had no 8th grade bilingual mathematics 
teacher for part of last year; this year Murchison was still 
understaffed in mathematics— one period each of seventh and eighth 
grade bilingual mathematics was taught. Thus, many Title VII 
students had mathematics with an English-speaking teacher (see Figure 
B-3). 

• Title VII high school gains exceeded 1 GE in mathematics and language 
at all grades (10. 11. 12) but were less than 1 GE (,2 GE) in reading 
at grades 10 and 12 (.4 GE). Grade 11 reading gains were strong (1.6 
GE), The number tested was leiis than 20 at grades 11 and 12. The 
reason for the low reading gains is unclear. Grade 9 gains cannot De 
discussed because students are tested with the ITBS in grade 8 and 
the TAP in grade 9. Test characteristics and norms are too 
dissimilar to allow valid comparisons (see Figure B-4). 
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FIGURE B-3 
GRA!~E 7 MURCHISON TITLE VII 
ITBS GE Srnr - '-SPRING. 1986 AND lh/B7 
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Figure B-4 
TAP KEAN 6E SCORES 
TITLE VII HIGH SC'iOOLS ONE-YEAR F0LLOH-UP~ 
1986 (PRE) AND 1987 (POST) 
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NoLe: Gains could not be calcuVited at grade 9 because students were tested at grade 8 with the ITBS. 1982 norms. 
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Evaluative! Question Ul-6 > Did participents who were tutored exMbit 
greater percentile gains, on the average, in English achievement 
compared to tnose not tutored? 

The overall student gains were examined for tutored and nontutored 
students. Grades 7-8 and grades 10-12 were collapsed to adjust for the 
small numbers tutored at individual grades. As can be seen in Figure B-S, 
tutored students exhibited more improv^ent than nontutcrGd in two- thirds or 
6 of 9 cocnparisons. (Note; This was erroneously reported as 6 of 8 
comparisons in Final Report 1986-87. The original was corrected 10/87.) 
Sample sizes were too small for significance testing. 



FIKJRE B-5 

PERCENTILE GAINS OF TUTORED AHO KONTUTOREO 
IITLE VII STUDEKTS ON THE 1987 ITBS/TAP 
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Only students tutored in each area witn pre- and posttests are included, no one tutorsd in social studies at 
grades 7 and 8 had both scores. 



Evaluation Question Did the percentage of tutored program 

participants making gains exceed that found If.st year? (aH four 
schools) 



The percentage of those students with gains in 1986-87 was compared to those 
with gains in 1985-86. The results are shown in Figure B-6. In 1987, a 
i^reater percentage of tutored students made gains in reading ^ mathematics, 
and science. However, caution should be noted in interpreting the findings; 
the number of tutored students with ITBS/TAP scores (excluding grade nine) 
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in 1987, was much smaller than in 1986. (The N was so small in both social 
studies and science that no real comparison can be made.) 

Figure B-6 

PERCENTAGE OF TUTORED STUDENTS WITH 
ITBS/TAP GAINS 1985-86 AND 1986-87 
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Discussion 

Overall acnievement goals were examined in terms of percentiles and grade 
equivalent scores. The formal oijjective, which stated that spring 1987 
percentiles of program students would be higher than their spring 1986 
percentiles, wai met in each subject Dy most grade levels; percentiles 
increased in 17 of 23 comparisons by subject and grade. While grade 
equivalent scores of Ti+le VII participants were well below th( national 
norms, in language secor.-ary program student gains exceeded 1 GE at all 
grade levels examined (7, 8, 10, 11, and 12). Seventh graders and all Title 
VII high school leve'ls (10, 11, and 12) also showed gains exceeding 1 GE in 
mathematics, the area in which program participants come closcist to the 
national norm. Generally, students are closing the gap. 

When the improvement of tutored and nontutored participants was examinee, 
tutored program students showed greater gains than nontutored in two-tnirds 
of the comparisons. Also, a greater percentage of tutored students made 
tiins in reading, mathematics, and science in 1987. However, the small 
number of tutored students with ITBS/TAP scores restrict analysis procedures 
and their interpretation. 
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; 8AR38586 «♦»♦ THIS WILL BE A SA5 OATASET 

i INPUT: EOY l<986 L£P FILE. 
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8965- 



_J\ttachment B-1 
tPage 1 of 6) 
ITBS/TAP Percentiles 
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TUTTOTAL ♦ TUTSCI; 
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*iNCLLDE>SA-BY00101C5 



SA-BY002 0401 " " 

INPUT: BARBa586 - SAS DATA SET 

CREATE GAINS IM EACH SUB.tECT AREA 
IfJPUT: SA-BYOOl OlOi) - TUTl-RfcD TIME IN EACH "SUBJECT"' ARgA 
^ MERGE £ CREATE TUTL^EU GROUPS IN EACH SUBJECT AREA 

<5 PRJC TABULATES UF TUTCREO GROUPS X PRE, POST* OAIN 



ERIC 



1440 

1450 

1460 

1470 

1480 

1490 

1500 

1510 

1520 

1530 

1540 

1550 

1560 

1570"" 

1580 

1590 

1600 

1610 

1620 

1630 

1640 

1650 

1660' 

1670 

1680 

'1690" 

1700 

1710_ 

1720 

1730 

1740 

1750 

1760 

1770 



0700 
0710 
0720 
0730 
0740 
0750 _ 
■ ■076b* 
0000077'J 
00000730 
00000790 
00000800 
00000810 
000C0820 " 
00000830 
00000840 . 
00000850 
00000860 
00000870 
00000880" 
00000890 
00000900 
00000910 
000009-0 
00000930 
00000940 
00000950 

" 2170 
2180 
2190 

2200 

2210 
2220 



APPENDIX. B 



I 



S A S LOG VSE SAS 82*4 



VSC 3*1 JOB EVOSASlb 



14:00 THURSOAY, 



I'iOTE: THE JOB EV0SAS16 HAS BEEN RUN UNDER RELEASE 82*4 OF SAS 
AT AUSTIN INOEHENDENT SCHCCL DISTRICT (01986001)* 

note: CPUIO VERSICN = FF SERIAL = C13553 MODEL = 4341 . 



note: NC OPTICNS SPECIFIED* 



1 

2 
3 
4 
5 
6 
7 
8 



0> 
o 

»— I 

X 

CD 



104 
105 
?06 

lor 

108 
109 



110 
111 
112 
113 
114 
115 

NOTE: 
NOTE; 




CPTION"ERRORS=0; 

* THIS PROGRAM PRINTS R 

* ITBS € TAP TEST SCORE 

* LP-T7TST CI OU THIS 
« STUOENfS VvITH BOTH A 



^00000130 

«3^:CE««:C<4'^«««<E<'««'^«««<c^«'e'^'^<'«4''e'^'^^^<E^4'<'^^'^^^^'^<''^ 00000140 

EPORTS OF TITLE VII STUDENTS PRE L POST * 00000150 

S. THIS USES A TAPE FILE CREATED BY™ '* 00000160 

IS LIKE LP-SAS16 01 01 EXCEPT THAT ONLY * 00000170 

PRE AND A POST TEST ARE INCLUDED* ^ 00000180 

4^^^^:^^^^^^^^^^^t^^:^i^^^^^^^^^K^^^^^^t^*t^^****^^^l 00000 190 

00000200 



DATA LP^TEMP; 
SET LP^TTLT; 

IF GRADE = 'ID* OR GRADE = 
IF RTFLAG NOT 'MISSING'; 

TITLEl •PROGRAM: LP-SAS16 



SAS LOG VSE SAS 82.4 



•IP CR GRADE = 'IZ'; 
/♦ INCLUDE ONLY THOSE 
/♦ 
02 01 



BOTH PRE r* POST 



WHO 
TESTS. 
AUSTIN 



HAD 



00001170 
00001180 
<:/ 00001190 
«/ 0C001200 
IN0EPEN0£N000012)0 



VSE 3.1 jns EV0SAS16 



T SCHOOL DISTRICT 

TirLC2 'DEPARTMENT OF MANA^-^MENT INFORMATION* ; '* 

TITLE3 'OFFICE OF RESEARCH ANO EVALUATION*'; 
- ,.UmE5 'STATISTICS FOR TITLE VII STUDENTS - GRADES 10-12'; 



DATA SET U?ERD1D.LP^TE:^P HAS 40 OBSERVATIONS AND 43 VARIABLES.' 34--0BS/TRK. " 
THE DATA STATEMENT USED 5.65 SECONDS ANO 330K. »^^«dl-:>. Ubb/IKK. 



00001220 
00001230 
0C00I24G 
00001250 
00001260 
0C001270 



PROC TABULATE OA TA=-LP_TEMP F = 8 MISSING; 
CLASS KTFLAG GRAOE TUTREAO ; 
KEYLABEL ALL='TLTAL« 



N='#'; 

TABLE GRACE ALLttRTFLAG ALL j *( TUTREAO ALL ) / RTS^IB MISSTEXT^- • 0 'T 
♦PROC SORT OATA=LP TEMP; 

* BY TUTREAC; - 



00001270" 
00001280 
•00001290 

0CO01300 
00001310 

•00001310^ 
00001320 
00001330 

■"00001340" 
00001350 
00001360 



00 
cn 



4i» 




14:C0 THURSC 



no rf 
0) rf 

m o 

m 
o 3 



CO 
I 



00 
Ch 

ro 



PrtOuRAiM; LP-SAS16 02 01 



AUSTIN INDEPENDENT SCHOOL DISTRICT 
OEPARTHENT OF MANAGEMENT INFORMATION 
OFFICE OF RESEARCH AND EVALUATION 



14:00 THURSDAY t JULY 2$ 1987 



♦ GAIN 



TUICREC *IN I TUTORED IK 
READING? 1 READING?^ 

N Y I N 1 Y 




STATISTICS FOR TITLE VI! STUDENTS -^GRA0ES^10»U 

READING } 
- GAIN 



I EVEN 

I TUTORED IN 

I READING? 

"l N I Y 



I 



READING 



I 

" I- 



TOTAL 



I ♦ GAIN I - GAIN I EVEN I 
\ TOTAL I TOTAL I TOTA. I 



TUTORED IN 
READING? 



i 



I 



— j 

y 

13} 



N 

I 



I I • ' I 1 

IZI U 11 01 ^1 

" " 21 ol 21 01 ei 21 

6i 01 01 01 41 

II 31 01 161 



It 



I 

I 

I 

171 



201 



■"""al""" ici 

"21I 3P 371 



M M ^« MM 



CO Pi 

n> O 



P'^OGi^AM; LP-SAS16 02 01 



AUSTIN INOEPEiNOENr SCHOOL DISTRICT 
OEPART.MENr OF MANAGEMENT INFORMATION 
OFFICE OF RESEARCH AND EVALUATIjN 

STATISTICS FOR TITLE VII -STl -NTS - GRADES i0-l2 

I TOTAL 

I TOTAL 

I GRADE 
1 10 
II ' 
12 



U:00 THURSDAYf JULY 



I 

" r 



I TOTAL 



181 
121 
101 

• ■MM I 

401 



NOTE: THE P.IOCEOURE TABULATE USED 5.23 SECONDS AND 592K AND PRINTED PAGES I TO 2. 



124 
125 
126 
127 
128 



PROC UNIVARIATE CATA=LP.TEMP FftEQ NORMAL; 
VAR PRERTPC POSTRTPC; 
* BY TLTREAC; 



00001360 " 

0C00I370 

00001380 

D0001390 

00001400 



88 



I— i m 



St 



09 



program: LP-SAS16 02 Ol 



AUSTIN INOEPENOENT SCHOOL DISTRICT 
OEPAf<TMENT OF MANAGEMENT INFCRMATICN 
OFFICE OF RESEARCH AND EVALUATION 



14:00 THURSOAYf JULY 2t 1987 



STATISTICS FOR TITLE .VU STUDENTS 
UNIVARIATE 



GRADES L0-L2 



VARIABLE^PRERTPC 



PRE READING XILE 



MOMENTS 



N 

MEAN 
STO OEV 
SKEviNESS 
USS 
CV 

T:MeAN=0 
SGM RANK 
NUM 0 
W: NORMAL 



40 
9.5 
7.20755 
0.6954B4 
5636 
75.8689 
'8.33616 
410 
40 

0.910993 



SilH ViGTS 


40 


SUK 


380 


VARIANCE 


51.94 87 


KLRTOSIS 


0.Z65373 


CSS 


2026 


STO MEAN 


1.13961 


PR08>|Tl 


O.OOOL 


PROD>iS| 


0.0001 


PROB<U 


<C.OI 



PERCENT5 



VALUE 


COUNT 


CELL 


CbM 


L 


8 


20.0 


20.0 


3 


2 


7.5 


27.5 


4 


I 


2.5 


3C.0 


5 


2 


5.0 


35.0 


6 


5 


12. C 


47.5 


9 


2 


5.0 


S2.5 



QUANTILES(0EF=»4) 



loo:« MAX 
75? Q3 
50% MEO 
25Z CI 
OX MIN 

RANGE 
Q3-QI 

MODE 



31 


^ 99% " 


31 


16.5 


95% 


20.95 


9 


90t 


17 


3 


' ioz 


I 


1 


5Z 


I 




1% 


I 



' 30 
13.5 
I 



FREQUENCY TABLE 







PERCENTS 


VALUE 


COUNT 


CELL CUM 


LO 


2 


5.0 57.5 


U 


L 


2.5 60.0 


L2 


2 


5«D 65.0 


13 


2 


5.0 70.0 


14 


■ I 


2.5 72.5 


15 


L 


2.5 75.0 



17 
20 

4.1 

^31 



00 

* 

ro 



EXTREMES 



\OHES 



HIGHEST 
17 
17 
20 
21 
31 



VALUE COUNT 



PERCENTS 
CELL CUM 
17.5~92;5' 
2.5 95.0 
2*5 97*5 
"215 lOO.tf 



I 

n 

9 
0 



90 



Di rf 
(Q Di 
CD O 
ZT 

tn 3 
ro 
o 3 
ri- 
al ^ 



91 



X 



3 



S A S LOG VSE SAS 82,4 



VSE 3.1 JOB EV0SAS16 



12:32 THURSDAY, JULY 2, 1987 



NOTE: INFILE T7012 HAS THE FCLLCWING CHARACTERISTICS: 
0CB=(BI.KSUE=1300,LRECL=:130,RE CFM=F) 



00 



45» 



NOTE: 
note: 
note: 

104 
105 
106 
107 
108 
109 
110 
111 
112 
113 

ii4 

115 

note: 
NOTE: 

115 
116 
117 

118 
119 
119 
120 
121 



HISSING VALUES hERE GENERATED AS A RESULT OF PERFORMING 
AN OPERATION ON MISSING VALLES. 

EACH PLACE IS GIVEN BY: (NUMBER OF TIMES) AT ( L INE) : (COLUMN ) . 
125 AT 38:14 132 AT 39:1^ 12!> AT 40:14 133 AT 41:14 228 AT 42:1A 
266 LINES WERE READ FROM INFILE T7012. 

DATA SET USER010.LP_TTL7 HAS 266 OBSERVATIONS AND 43 VARIABLES. 34 CBS/lRr.* 
THE DATA STAT^HENf LSEC 50.97 SECONDS AND 330K. 

DATA LP^TEMP; 
SET LP^TTLT; 

IF GRADE = •10« OR GRADE = Ul' GR GRADE = •IZ*; 
If RTFLAG NOT = •MISSING*; /« INCLUDE ONLY THOSE WHO HAD */ 

/» BOTH PRE Z POST TESTS. */ 
riTLEl •PRCGRAM: LP-SAS16 02 01 AUSTIN IN0EPENDEN00001210 

, T SCHOOL CI STRICT t; 00001220 

00001230 
0C001240 
00001250 
00001260" 
00001270 



00001160 
00001170 
00001180 
00001190 
00001200 



TITLE2 'DEPARTMENT OF MANAGEMENT INFORMATION*; 

riTLE3 •OFFICE OF RESEARCH ANO EVALUATION^; 

TITLE*) 'STATISTICS FOR TITLE VII STUDENTS • GRADES 10-12»; 



DATA SET USEROIO.LP^TEMP HAS 40 OBSERVATIONS ^M 43 VARIABLES. 34 OBS/TRK,^ 
THE DATA STATEMENT USEC 3.68 SECONDS ANO iHK. 

PROC TABULATE OA T, ==LP^TEMP F==8 MKSING; 
CLASS RTFLAG GKADE TUTREAO; 
^KEYLABEL ALL=«TOTAL^ 

TABLE GRADE ALLj (RTFLAG ALL) *( TUTREAO ALL) / RTS=18 MISSTEXT»«0^ ; 



00001270 
00001280 
00001290 

00001300 
0C001310 
00001310 
00001320 
00001330 



92 



93 



c 

rt* 00 OJ 
O CO<Q 
-S ^ fD 

Q- > l-a 

OJ O 

Q. fD 

z n ^ 

O fD 

rl- 

C — » 
rh fD 
O W 
-$ 
fD 



a- 
n 



fD 

a- 

00 

r\3 



S A S LOG VSE SAS 82*4 



VSE 3a JOB EV0SAS16 



ELSE 

"IF LTGAIN > 0 
ELSe 

IF LTGAIN < 0 
ELSE LTFLAG = 

IF MTGAIN = 
ELSE 

IF MTGAIN > 0 
ELSE 

IF MTGAIN < 0 
ELSE MTFLAG - 

IF SSGAIN = •< 
ELSE 

IF SSGAIN > 0 
ELSE 

IF SSGAIN < 0 
ELSE SSFLAG ^ 

IF SCGAIN = • 
ELSE 

IF SCGAIN > 0 
ELSE 

IF SCGAIN < 0 
ELSE SCFLAG - 



THEN LTFLAG = •+ GAIN«; 

THEN LTFLAG = GAIN*; 
•EVEN' ; 

J THEN fTFLAG = 'MISSING'; 

THEN MTFLAG = GAIN*; 

THEN MTFLAG = GAIN"; 
•EVEN" ; 

►• THEN SSFLAG = 'MISSING'; 

THEN SSFLAG = '+ GAIN'; 

THEN SSFLAG = '- GAUr; 
'EVEN' ; 

♦' THEN SCFLAG = 'MISSING'; 

THEN SCFLAG = '* GAIN'; 

THEN SCFLAG = '- GAIN' ; 
'EVEN' ; 



LABEL RTF LAG = 
LTFLAG = 
MTFLAG = 
SSFLAG = 
SCFLAG « 
PRERTPC = 
POSTPTPC 
PRELTPC ' 
POSTLTPC 
PREKTPC 
POSTMTPC 
PRESSPC 
POSTSSPC 
PRESCFC 
PDSTSCPC 
TUTREAO 
TUTLANG 
TUTHATH 
TUT sees T 
TUTSC = 



'READING' 

'LANGUAGE' 

'HATH' 

' SOCIAL STUDIES* 
'SCIENCE' 

'PRE READING ^ILE' 
= 'POST READING ^ILE' 
: 'PRE LANGUAGE ULE' 
=5 •POST LANGUAGE %ILE* 
= •PRE HATH ?ILE^ 
=5 •POST MATH ilLE^ 
: •PRE SOCIAL STUDIES %ILE^ 
= •POST SOCIAL STUDIES «ILE' • 
= •PRE SCIENCE %ILE' 
' •POST SCIENCE 2ILE^ 
= •TUTORED IN READING?^ 
= 'TLTCRED IN LANGUAGE?^ 
» •TUTORED IN MATH?' 
= 'TUTCRED IN SCCIAL STUDIES?' 
'TUTORED IN SCIENCE?'^ 



DROP PRERTGE PRELTGE PREMTGE P^^^SSCE PRESCGE 

P0STRT6E POSTLTGE POSTMTGE HOSTSSGE POSTSCGE 



TO NUMERIC 

:6R VALUt::> n«v^ — --7; 

VALUES 

44:17 5i:l7 58:17 65:17 72:17 



12:32 THURSDAYf JULY 2i 1987 



00000640 




00000650 




,00000660 


00 


00000670 


00000680 


• 


00000690 


ro 


0C000700 




00000710 


- 


00000720 




00000730 




* *"000001<^0 




00000750 




00000760 


. 


' 00000770 




00000780 




00000790 





00000800 




00000810 




00000820 


^. , 


"00000830 




00000840 




00000850 




' " 00000860 




00000870 




00000880 




'^."00000890" 




00000900 




00000910 




00000920* 




00000930 




00000940 




0C000950 




00000S60 




00000970 




00000980 




00000990 




OCOOIOOO 




OOOOlOlO 




00001020 




00001030 
00001040 ' 




00001050 




0C001C60 




00001070 


ro 3 


00001080 


ncooiC90 

' OOOOLLOO 


0 3 

. ♦ — • — " ' - CT — 


OOOOiLLO 




0000LL20 


1 

ro 


00C0LL30 


00001140 




00001150 




0C001160 





95, 



S A S LOG VSE SAS 82.4 



VS£ 3.1 J06 EV0SAS16 



» m 

o 
»— I 

X 
CD 



eric; 



52 
53 
54 
55 
56 

c 7 

59 

oO 

bl 

62 

63 

64 

65 

66 

67 

68 

69 

7C 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 

81 

82 

U3 

84 

85 

86 

87 

88 

89 

90 

91 

92 

9J 

94 

95 

96 

97 

98 

99 

100 

101 

102 

103 

104 

NOTE: 



ELSE 

IF LIGAIN > 0 THCN LTFLAG = GAIN*; 

IF^LTGAiN < 0 THEN LTFLAG - GAIN*; 
ELSE LTFLAG ' 'EVEN*; 

= Thf.W .VTFLAG « SMISSING*; 

ELSE 

IF HTGAIN > 0 THEN MTFLAG = GAIN*, 
ELSE 

IF aiGAIN < 0 THEN MTFLAG = OAIN»: 
ELSE MTFLAG = 'EVEN* t 

IF SSGAIN = THEN SSFLAG = 'MISSINGS 

ELSE 

IF SSGAIN > 0 THEN SSFLAG « GAIN*; 
ELSE 

IF SSGAIN < 0 THEN SSFLAG = GAIN*; 
ELSE SSFLAG = 'EVEN* ; 

IF SCGAIN = THEN SCFLAG = 'MISSING*; 

ELSE 

IF SCGAIN > 0 THEN SCFLAG = GAIN*; 
ELSE 

If SCGAIN < 0 THEN SCFLAG = GAIN*; 
ELJE SCFLAG = •EVEN* t 

LABEL RTFLAG = •READING* 
LTFLAG = •LANGUAGE • 
MTFLAG = •MATH* 
SSFLAG = •SCCIAL STUDIES* 
SCFLAG - •SCIENCE* 
PRERTPC » »PRE BEADING SILE* 
POSTPTPC = *POST READING ilLE* 
PRELTPC - *P:^E LANGUAGE ^ILE* 
POSTLTPC =» 'POST LANGUAGE XlLB* 
PREfTPC = *PRE MATH ?ILE* 
POSTMTPC = *POST MATH itLE* 
t'RESSPC = *PKE SOCIAL STUDIES tILE* 
POSTSSPC = *PCST SOCIAL STUDIES «ILE« 
PRESCPC 3 *PRE SCIENCE «ILE* 
POSTSCPC ' *P0ST SCIENCE TILE* 
TUTREAD = *rUTCPEO IN READING?* 
TUTLANG = * TUTORED IN LANGUAGE?* 
TUTfATH « •TUTORED IN HATH?' 
TUTSCCST = »TUTCR6D IN SCCIAL STUDIES?* 
TUTSC = *TUTCRED IN SCIENCE?*? 

DROP PRERTGE PRELTGE PRE.MTGE PRESSGt PRESCGE 

PCSTRTGE POSTLTGE POSTMTGE PCSTSSGE POSTSCGE 



CHARACTER VALUES HAVE BEEN ^Rt'^^f I^rS 1"^ 
VALUES AT THE PLACES GIVEN BY: CL INEI .( COLUMN J . 



4A:17 5l:l7 58:17 65:17 72sl7 



12:32 THURSDAYt JULY 2t 1987 

00000640 
00000650 

00000660 g O 

00000670 

00000680 ' ' 

00000690 *^ O 

0C000700 
00000710 
00000720 
0C00073G 
00000 740 " 

00000750 • 

00000 760 

00000770 

00000780 9 

00000790 _ _ _ ^ . ^ . ► 

"00000800 " " 

00000810 0 

00000820 _ _ 

'0000C830 ""^ _ 

00000840 

00000850 ; , . 

00000860' 

00000870 ^ 

00000880 _ . 

."OC00C8C0' 

00000900 ® 

00000910 _ . . > 

"00000920" ■ 
00000930 
00000940 

00000950 ' — - 

00000960 C 
00000970 

00000980 " ' ' " - 

00000990 C 

OCOOIOOO 

00001010 

0C001020 O 
0C001030 

'00001040 ' 
00001050 

OC001C60 cr5 

00001070 - " • 5^ c? ^ 

00001080 CO P O 



00001C90 



n> o 



o a 



O 



00001100 " U> 3 ^ 

0000 1 1 10 _ 5 O 

00001120 
•O0CC1130 

O0001140 ^ CD 

00001150 ^ I 

OC001160 ^ - - - ^ 

97 



1 



S A S LOG VSE SAS 62*^ 



VSE 3*1 JOB EV0SAS16 



12:32 THURSOAY, JULY 2. 1987 



> 
m 

00 2 
X 

a? 



ERIC 



NOTE.:. .THE . JOB E.V0LAS16 H^S BEEN RUN INOER RELEASE 82*4 OF SAS 
AT AUSTW INDEPENOENT SCHOOL OXSTRICT (0l"98600l)» 



NOTE5.^CpyiO YERSICN ».fF_SERJAL 

NOTEx NC OPTIONS SPECIFIEC* 



.013553 HOOEL » ^341 



2 
3 
' \ 
5 

■ 7 
8 
9 

"'lb" 
11 

12 

" 13"' 
1^ 
15 

' 16 
17 
18 
19 
20 
21 

"22* 
23 
Z'i 
25 
26 
27 
28 
29 
30 

' 31 ■ 
32 
33 

35 

36 

37 ^ 

38 

39 

«0 

«1 

«2 

«3 

^ii 

«5 

4*^ 
48 
«9 
50 
51 



OPTION ERRORS»0; ' ' " 

♦ .. .THIS, PROGRAM PRINTS REPORTS OF TITLE VII STUOENTS PRE C POST ♦ 

♦ ITOS C TAP TEST SCORES, THIS USCS A TAPE FILE CREATEO BY ♦ 

♦ LP-T7TST 01 OU THIS IS LIKE LP-SAS16 01 01 EXCEPT THAT ONLY ♦ 
STUOENTS klTH^BOTH A PRE ANO A POST TEST ARE INCLUOEO, ♦ 



OATA tP_TTL7; 

INFllE T70I2 LReCL=130 BLKSIZE=1 
INPUT STU.IO S 1-7 STU.WAH S 8- 

TUTREAU S 53 TLTLANG S 54 

"TUTSOCST S 56""TUTSC S 57 
PRE^TST S 58-61 PRE^GRO S 



300 RECFMaF; • 
34 LOC S 36-38 
TUTHATH S 55 



GRAOE S 3<}«*40 



PRERTSC 

■ PRELTSC 
PREHTSC 
PRESSSC 
PRESCSC 
POST^TST S 
POSTKTSC S 

^POSTLTSC % 
POSIHTSC % 
POSTSSSC S 
FOSTSCSC % 



64 
70 
76 
82 
88 



PR^RTGE 
PRELTGE 
PREKTGE 
PRESSGE 
PRESCGE 



S 65 
S 71 
S 77 
% 83 
S 89 



62-63 

67 PRERTPC 
PRELTPC 
PREHTPC 
PRESSPC 
PRESCPC 



73 
-79 

85 
91 



66-69 
74-75 
80-81 
86-87 
92-93 



94-97 POST^GRO 
100 POSTRTGE S 
106' POSTLTGE ( 
112 POSTHTGE $ 
118 PUSTSSGE S 
124 POSTSCGE S 



S 98-99 
101-103 
107-109 
113-115 
119-121 
125-127 



PCSTRTPC 
PCSTLTPC 
POSTHTPC 
POSTSSPC 
PUSTSCPC 



104-105 
IIO-III 
1I6-II7 
122-123 
120-129; 



IF TUTREAD = • • THEN TUTREAD » 'N*; 
ELSE^TUfREAO « 'Y'; " 
IF TU7LANG = • • THEN TUTLANG = 'N'; 
ELSE TUTLANG = 'Y'; 
■ if "TUTMATH * • • THEN TUTHATH = 'N»; 
ELSE TUTHATH » 

IF TUTSOCST = • • THEN TUTSOCST = 'N*; 
ELSE'TLTSOCST a 'Y'; 
IF rUTSC = • • THEN TLTSC = 'N*; 
ELSE TUTSC ^ 'Y* ; 

RTGAIN a POSTRTPC - PRERTPC; 

LTGAIN = PCSTLTPC - PRELTPC; 

HTGAIN » FCSTHTPC - PREHTPC; 

SSGAIN = POSTSSPC - PRESSPCl 

SCGAIN « PCSTSCPC - PRESCPC; 

IF RTGAIN THEN RTFLAG = "HISSING*; 

ELSE • 

IF RlGAiN ^ 0 THEN RTFLAG = GAIN'; 
ELSE 

IF RTGAIN < 0 THEN RTFLAG = GAIN*; 

ELSE RTFLAG » 'EVEN' ; 

IF LTGAIN « THEN LTFLAG = 'HISSING'; 



98 
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S A S LOG VSE SAS 82«4 



VSE 3«I JOB EV0SAS16 



I2;32 THURSOAYt JULY 2t 1987 



100, 
ERIC 



-NQTE.LTHE. JOB E.V0SAS16 HAS BEEN RUN LNOER RELEASE 82*4 OF SAS 
AT AUSTIN INOEPENOENT SCHOOL DISTRICT (0r98600l)* 

NOTEl.Cpyip^ VERSICN = FF .SERIAL = 013553 HOOEL - 4341 . 

NOTE: NC OPTIONS SPECIFIED. 



I 

2 
3 

5 
6 

; 8 

L ^ 

16" 

II 

12 

I 

16 
17 
18 

■""19 
20 

22 
23 
24 

t~25~ 

i 

I 27 
^28"^ 
29 
30 

r-3r 

i 32 
I 33 
34"' 
35 
36 
:^37 
38 
39 

41 
42 

r"43 

. 44 

: 45 

4-6- 

47 

48 

49 

50 

51 



OPTION ERRORStrO; 

. THIS PROGRAM PRINTS REPORTS OF TITLE VII STUOENTS PRE C POST * 

ITBS C TAP TEST SCORES. THIS USES A TAPE FILE CREATED BY * 

LP-T7TST 01 01. THIS IS uIKE LP-SAS16 01 01 EXCEPT THAT ONLY * 

_ STUD.ENTS MTH BOTH A PRE AND A POST TEST ARE INCLUDED. * 



JATA LP^TTLV; 

'lNFrLE"T7012 LRECL=1 
INPUT STUPID $ 1-7 

TUTREAD 53 

"fUTSOCST $ 56" 
PRE^TST $ 58-6 
PRERTSC $ 64 

'preLtsc $ 70 
prehtsc s 76 

PRESSSC $ 82 

>RESCSC $ 68 
PDST^TST $ 94- 

POSTRTSC % 100 

POSTLTSC $ 106 
POSTrtTSC $ 112 

POSTSSSC $ 118 

^ POSTSCSC $ 124 



30 BLKSI2E=«1 
STU^NAH $ 8- 
TITLANG $ 54 
' TUTSC $ 57 
1 PRE^GKD $ 



300 recfm^f; 

34 LOC $ 36-38 
TUTMATH $ 55 



GRADE J 39-40 



PRERTGE 
PRELTGE 
PREHTGE 
PRESSGE 
PRESCGE 
97 POST^GRO 
POSTRTGE $ 
POSTLTGE 
POSTHTGE 
POSTSSGE 
POSTSCGE 



62-^ i 

67 PRERTPC 
PRELTPC 
PREMTPC 
PRESSPC 
PRESCPC 



73 
-79 

8? 
91 



68-69 
74-75 
80-81 
86-87 
92-93 



IF TUTREAD « • 
^ECSE TUTREAD = 
IF TUTLAt^G = • 
ELSE TUTLA^G = 
IF" TUTMATH' a • 
ELSE TUTMATH ^ 
IF TUTSDCST = 
'ELSE'"TtTSOCST 



• THEN TUTREAD = 

lyi; 

• THEN TUTLANG = 

lyi; 

• THEN TUTMATH = 
lyt ; 

• • THEN TUTSOCST 



$ 98-99 
101-103 
107-109 
113-115 
119-121 
125-127 

•N»; 



PCSTRTPC 
PCSTLTPC 
POSTMTPC 
PDSTSSPC 
PGSTSCPC 



104-105 
llO-lll 
116-117 
122-123 
128-129; 



•N»; 



IF TUTSC = • • THEN TITSC » 'N'; 
ELSE TUTSC « •Y* ; 

RTG'AIN = POSTRTPC - PRERTPC; 

LTGAIN = POSTLTPC - PRELTPC; 

MTGAIK * PCSTMTPC - PREMTPC; 

SSGAIN * POSTSSPC - PRESSPC; 

SCGAIN « PCSTSCPC - PRESC:>C; 

IF RTGAIN = THEN RTFLAG = "HISSING*; 

ELSE • 

IF RVGAIN > 0 THEN RTFLAG = GAIN*; 
ELSE 

IF RTGAIN < 0 THEN RTFLAG = GAIN'; 

ELSE RTFLAG a 'EVEN' ; 

IF LTGAIN « THEN LTFLAG = 'HISSING* ; 



00000130 
0C000140 
00000150 
0C000160 
0C000170 
00000180 
00000190 
0C000200 
00000210 
00000220 
0C000230 
00000240 
00000250 
0C000260 
00000270 
00000280 
00000290 
000U0300 
00000310 
000C0320 
0C000330 
00000 340 
0C000350 
0C00C360 
00000370 
0C000380 
0C00C390 
00000400 
00000410 
0C000420 
00000430 
00000440 
0C000450 
00000460 
00000470 
00000480 
00000490 
00000500 
0C000510 
0C000520 
00000530 
00000540 
0C000550 
00000560 
00000570 
00000580 
00000590 
00000600 
00000610 
0C000620 
00000630 
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AUSTIN INDEPENDENT SCHOOL DISTRICT 

DEPARTMENT OF MANAGEMENT INFORMATION 
OFFICE OF RE SEARCH AND EVALUATION 

FREQUENCIES OF PRE S <>OST TEST SCORES 
FOR TITLE VII STUDENTS 



14:0a TUESDAY. JUNE 23, 1987 




.. — JJ^ 

m 
M z 


i GRADE " 


1 "~ 
1 

I 


1 
1 

321 


1 
I 

621 


1 
1 

71 




o o 
•—1 

-><:. . 


107 


69 


oc 


108 


1 


261 


401 


171 
131 


57 




109 


"■ 1 


351 


551 


68 




110 


1 


211 


331 


61 


39 




ill 


1 
1 


6] 


151 


31 


18 




112 


51 


151 


01 
461 


15 




ITOTAL _ 


1 


125] 


2201 


266 



TOZ 



s 

4 

0 
7 

i 

A 

n 

12 



"2. ^ J 



"W'S 



^> 
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(D 
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AUSTIN IN0EP6N0ENT SCHOOL DISTRICT 
DEPARTMENT OF MANAGEMENT INFORMATION 
OFFICE Of RESEARCH AND EVALUATION 



14J08 TUESOAYt JUNE 23t 1987 11 



FREQUENCIES 
FOR 



OF PRE 6 POST TEST 
TITLE VII STUDENTS 



SCORES 
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Attachment B-3 
GRADE EqUIVALENT SCORES-1986 TO 1987~BY GRADE 
(Page 1 of 23) 
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.> 

-o 
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AUSTIN iNDEPENDENT SCHOOL DISTRICT 
OFFICE Of RESEARCH AND EVALUATION 



FINAL REPORTS 
SA-JF080 OlOl 



ONE YEAR FOLLOW UP - I986-I987 
SPANISH - DOMINANCE A OR B OR C 
JRHI - TITLE VII 



15:20 THURSDAY, JUNE 1 



I POSTREAD 



TITLE VIl 



I GRADE 
I 



1 ^ 


SUH 1 


N 1 


MEAN 1 


N 1 


MEAN 1 


N 1 


MEAN 1 


I GRADE 


1 


1 


1 








1 


107 I 




«i 


I 

3.541 


651 


4.941 


301 


3.811 


ioa- i 

I ^. 


541 


331 


5.071 


541 


6.161 


331 


5.251 


I TOTAL I 


1201 


661 


4.281 


II91 


5.491 


631 


4.571 



1 POST LANG 




00 

ro 



^ ^ <^ 

H) T3 O 

o =r 
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-J. n> 
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ro »— 4 CD 

CO ^ I 
^ — U3 CO 
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cn 
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Attachment B-3 
(ITBS/TAP-Tested in Reading) 
(Page 3 of 23) 



AUSTIN INDEPENDENT SCHOOL DISTRICT FINAL REPORTS 

OFFICE OF RESEARCH AND EVALUATION SA-JF080 0101 

15:20 THUR 

ONE YEAR FOLLOW UP - 1986-1987 
SPANISH - DOMINANCE = A OR B OR C 

JRHI - TITLE VII T^-^TreOIJl |t»ftO/iO<S' 



CT ATIJ^ 

O 1 M 1 W ^ 






ri% c w 


DPprPMT 


u u n 


DP Qr PMT 


Cm 






0*T 






OA 1 1 A 


7 






OO 






1 rtrt (\(\(\ 


OOMINANC 


FREQUENCY 


CUM 


FREQ 


PERCENT 


CUM 


PERCENT 


A 


18 




18 


26.471 




26.471 


B 


34 




52 


50.000 




76.471 


C 


16 




68 


23.529 




100.000 


LEPYEARS 


. FREQUENCY 


CUM 


FREQ 


PERCENT 


CUM 


PERCENT 


0.44 


2 




2 


2.941 




2.941 


1 


3 




5 


4.412 




7.353 


1.32 


1 




6 


1.471 




8.824 


1.68 


23 




29 


33.824 




42.647 


2.32 


4 




33 


5.882 




48.529 


2.68 


10 




43 


14,706 




63.235 


3 


2 




45 


2.941 




66.176 


3.32 


1 




46 


1.471 




67.647 


3.68 


5 




51 


7.353 




75.000 


■4.32 


1 




52 


1.471 




76.471 


5.68 


2 




54 


2.941 




79.412 


6.32 


t 




55 


1.471 




80.882 


6.68 


4 




59 


5.882 




86.765 


7.24 


1 




60 


1.471 




88.235 


7.32 


2 




62 


2.941 




91.176 


7.68 


2 




64 


2.941 




94.118 


8.68 


4 




68 


5.882 




100.000 
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Attachment B-3 
(Page 4 of 23) 



AUSTIN INDEPENDENT SCHOOL DISTRICT 
OFFICE OF RESEARCH AND EVALUATION 



FINAL REPORTS 
SA-JF080 0101 



ONE YEAR FCLLOH UP - 1986-1987 
SPANISH - DOMINANCE = A OR B OR C 
JRHI - NOT TITLE VII 



15:20 THURSDAY! 



STATUS 


FREQUENCY 


CUM 


FREQ 


PERCENT 


CUM 


PERCENT 


2 


59 




59 


88.060 




88.060 


7 


7 




66 


10.448 




98.507 


8 


1 




67 


1.493 




100.000 


DOMINANC 


FREQUENCY 


CUM 


FREQ 


PERCENT 


CUM 


PERCENT 


A 


4 




4 


5.970 




5.970 


B 


12 




16 


17.910 




23^.881 


C 


51 




67 


76.119 




100.000 


LEPYEARS 


FREQUENCY 


CUM 


FREQ 


PERCENT 


CUM 


PERCENT 


0.32 


1 




1 


1.49 3 




1.493 


1.32 


2 




3 


2.985 




4.478 


1.68 


5 




8 


7.463 




11.940 


2.68 


1 




9 


1.493 




13.433 


3 


3 




12 


4.478 




17.910 


3.16 


1 




13 


l',*9 3 




19.403 


3.32 


1 




14 


1.493 




20.896 


3.68 


6 




20 


8.955 




29.851 


4.32 


2 




22 


2.985 




32.836 


4.44 


1 




23 


1.493 




34.328 


4.68 


5 




28 


7.463 




41.791 


5.32 


1 




29 


1.493 




43.284 


5.68 


2 




31 


2.98 5 




46.269 


6 


1 




32 


1.493 




47.761 


6.32 


I 




33 


1.493 




49.254 


6.68 


12 




45 


17.910 




67.164. 


7 


1 




46 


1.493 




68.657 


7.32 


1 




47 


1.493 




70.149 


7.68 


11 




58 


16.418 




86.567 


8.68 


9 




67 


13.433 




100.000 
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Attachment B-3 
(Page 5 of 23) 



AUSTIN INDEPENDENT SCHOOL DISTRICT 
OFFICE OF RESEARCH AND EVALUATION 

CNE YEAR FOLLOW UP - 



SPANISH - DOMINANCE = 
SRHl - TITLE 

STATUS FREQUENCY CUM FREQ 

2 71 71 

7 3 74 

DOMINANC FREQUENCY CUM FREQ 

A ■ I 1 

8 57 58 

C • 16 74 

LEPYEARS FREQUENCY CUM FREQ 

0 I I 
0.52 I 2 

1 5 7 
1.32 I 8 
1.68 24 32 

2 2 34 
2.32 I 35 
2.68 6 41 

3 2 43 
3.68 9 52 

4 3 55 
4.32 3 58 
4.68 2 60 
5.68 4 64 
5.84 I 65 
6.32 2 67 
6.68 I 68 
7.68 2 70 
8.68 4 74 



FINAL REPORTS 
SA-JF080 0101 

15:20 THU? 

I986-I987 
A OR 8 OR C 

vii TgeieO ee^OifOGT- 



PERCENT 


LUn 




9 5 • 94o 




QS; OA A 






^ u u • u u u 


a c o c M T 


u n 




1.351 




1. 351 


77.027 




78.378 


21.622 




100.000 


PERCENT 


CUM 


PERCENT 


1. 351 




I. 351 


1.351 




2.703 


6.757 




9.459 


1.351 




10.811 


32.432 




43.243 


2.703 




45.946 


1. 351 




47.297 


8.108 




55.405 


2.703 




58.108 


12.162 




70.270 


4.054 




74.324 


4.054 




78.378 


2.703 




81.081 


5.405 




86.486 


1.351 




87.838 


2.703 




90.541 


1.351 




91.892 


2.703 




94.595 


5.405 




100.000 
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Attachment B-3 
(Page 6 of 23) 



AUSTIN INDEPENDENT SCHOOL DISTRICT FINAL REPORTS 

OFFICE OF RESEARCH AND EVALUATION SA-JF080 0101 

ONE YEAR FGLLOH UP - 1986-1987 
SPANISH - DOMINANCE = A OR B OR C 

SRHI - NOT TITLE VII TS-'TT^.O f AJ (S-SvA D t yU* 

STATUS FREQUENCY CUM FREQ PERCENT CUM PERCENT 



2 
7 



A 
B 
C 



0.6 

1 

1.68 
2.68 
3.32 

3.68 
4 

4.32 
4.68 
5.32 
5.68 
6.68 
7.68 
8.68 



27 
8 



27 
35 



77.143 

22.857 



77.143 
100.000 



DCMINA.NC FREQUENCY CUM FREQ PERCENT CUM PERCENT 



1 

24 
10 



1 

25 
35 



2.857 
68.571 

28*571 



2.857 
71.429 
100.000 



LEPYEARS FREQUENCY CUM FREQ PERCENT CUM PERCENT 



3 
1 
4 
3 
2 
2 
1 
1 
3 
3 
4 
3 
3 
2 



3 
4 
8 
11 
13 
15 
16 
17 
20 
23 
27 
30 
33 
35 



8.571 
2.857 

11.429 
8.571 
5.714 
5.714 
2.857 
2.857 
8.571 
8.571 

11.429 
8.571 
8.571 
5.714 



8.571 
11.429 
22.857 
31.429 
37.143 
42.857 
45,714 
43.571 
57.143 
65.714 
77.143 
85.714 
94.286 
100.000 
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Attachment B-3 
(Page 7 of 23) 



AUSTIN INDEPENDENT SCHOOL DISTRICT 
OFFICE OF RESEARCH AND EVALUATION 



FINAL REPORTS 
SA^JFOOO 0101 



ONE YEAR FOLLOW UP - 1986-1987 
SPANISH - DOMINA NCE = A O R 8 OR C 
JRHI -dTlTLE Vf 



1 NUMB I PREREAD | POSTREAD l.READGAIN 
I SUM I MEAN I MEAN | MEAN 




15:20 THL 
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Attachment B-3 
(Page 8 of 23) 



AUSTIN INDEPENDENT SCHOOL DISTRICT 
OFFICE CF RESEARCH AND EVALUATION 



FINAL REPORTS 
SA-JF080 0101 



DNE YEAR FOLLOW UP - 1986-1987 
SPANISH - nnM lMANCF = A flR B OR C 
JRHI - CNOT TITLE V1 



I NUMB I PREREAD IPOSTREAO IREADGAIN 
I SUM I MEAN I MEAN I MEAN 




I TOTAL 



15:20 THURS 



ERIC 
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Attachment B-3 
(Page 9 of 23) 



AUSTIN INDEPENDENT SCHOOL DISTRICT ciNAL REPORTS 

OFFICE OF RESEARCH AND EVALUATION SA-JF080 OlQl 

15:20 TH 

ONE YEAR FOLLOW UP - I986-I987 
SPANISH - DOMINANCE = A OR 8 CR C 
SRHI - NOT TITLE VII 



j I NUMB I PREREAD IPOSTREAD IREADGAIN I 

{™-. j SUM I MEAN I MEAN | MEAN | 

I GRACE I ""l ™] ™™|' -I 

I 1 I I { I 

jC^ 1^ 281 6.56 1 7.651 1 .09 1 

^ ^ I ^1 6.901 7.8oI 0.90 1 

I II 5.701 7.5oI irso'l 

I 351 6. 59 1 7.67! iTos! 

I GRADE 1 ~ "I -|— -~l 

j^f I 281 6.75 I 7.641 0.90 1 

I ^' 7*501 9.4oI "Trgol 

I II 8*9oI iTao! 

jl-I™, ' '^TTai iTogj 

I GRADE ' I "I"" I ""I { 

\^ I 281 7.741 8.351 0.6li 

{i° ^^^^ I 6J ^.05 1 10.15!""~2~! 

1^ ^1 6.701 " 9.901 ITzol 

1 351 7™! ~U 07941 
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Attachment B-3 
(Page 10 of 23) 



AUSTIN INDEPENDENT SCHOOL DISTRICT FINAL REPORTS 

OFFICE OF RESEARCH AND EVALUATION SA-JF08O 0101 

15:20 V 





ONE YEAR 


IF" ft ft ft fl t A 

FOLLOW UP 


- 1986-1987 






SPANISH - 


DOMINANCE 


= A OR B 


DR C 




GRADE 


FREQUENCY 


CUM FREQ 


PERCENT 


CUM 


PERCENT 


07 


143 


143 


34-963 




34.963 


08 


75 


218 


L8.337 




53,301 


09 


98 


316 


23.961 




77.262 


10 


58 


374 


14.181 




91.443 


11 


21 


395 


5.134 




96.577 


12 


14 


409- 


3.423 




100.000 


STATUS 


FREQUENCY 


CUM FREQ 


PERCENT 


CUH 


PERCENT 


2 


382 


382 


93.399 




93.399 


7 


26 


408 


6.357 




99.756 


8 


1 


409 


0.244 




lOO.O'OO 


LANGGRP 


FREQUENCY 


CUM .FREQ 


PERCENT 


CUM 


PERCENT 


SPAN 


409 


409 


100.000 




100.000 


DOMINANC 


FREQUENCY 


CUM FREQ 


PERCENT 


CUH 


PERCENT 


A 


41 


41 


10.024 




10.024 


8 


•242 


283 


59.169 




69.193 


C 


126 


409 


30.807 




100.000 


SCHGROUP 


FREQUENCY 


CUM FREQ 


PERCENT 


CUM 


PERCENT 


JRHI 


218 


218 


53.301 




53.301 


SRHI 


191 


409 


46.699 




100.000 


TITLE7 


FREQUENCY 


CUM FREQ 


PERCENT 


CUM 


PERCENT 


T7N0X 


156 


156 


38.142 




38.142 


T7YES 


■ 253 


409 


61.858 




100.000 



ER?C • ^ 
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AUSTIN INDEPENDENT SCHOOL DISTRICT FINAL REPORTS 

OFFICE OF RESEARCH AND EVALUATION SA-JF080 0101 

15:20 Thl 

ONe YEAR FOLLOW UP - 1986-1987 
SPANISH - DOMINANCE = A OR B OR C 

LEPYEARS FREQUENCY CUM FREQ PERCENT GUM PERCENT 





1 




• 


• 


0 


2 


2 


0-490 


0-490 


0-08 


1 






0 7^5 


0- 16 


4 


7 


0-980 


1-716 


0-24 

\J • Cm f 


8 


15 


1-96 1 


"\ A7A 




1 


1 6 




O • 7 ^ ^ 


0-44 


8 


74 


1 9A 1 


<i fl fl 2 


0- 52 


2 


26 


0-490 






77 


X w 


1 8- R7^ 


2 ^5 24*5 


0-68 


A 
w 


109 


1-471 


26. 716 


1 


9 


13 


^ -206 


28-922 

U • J Cm Cm 


1-32 

A, % J Cm 


A 

w 


124 


1-471 


30-392 


1-68 


72 


196 


17-647 


48-039 


2 


7 


^ w ^ 


I -71 6 


49-755 


2.32 


6 


209 


1.471 


51.225 


2.68 


22 


231 


5.392 


56.518 


3 


9 


240 


2o206 


58.824 


3. 16 


I 


241 


0.245 


59.069 


3.32 


6 


247 


1.471 


60.539 


3.68 


27 


274 


6.618 


67.157 


h 


6 


280 


1.471 


68.627 


4.32 


7 


287 


1.71 6 


70.343 


4.44 


I 


288 


0.245 


70.588 


4.68 


15 


303 


3.676 


74.265 


5 


I 


304 


0.245 


74,510 


5.32 


6 


310 


i.471 


75.980 


5.68 


15 


325 


3.676 


79.657 


5.84 


1 


326 


0.245 


79.902 


6 


2 


328 


0.490 


80.392 


6.32 


4 


332 


0.980 


81.373 


6.68 


25 


357 


6.127 


87.500 


7 


1 


358 


0.245 


87.745 


7.24 


1 


359 


0.245 


87.990 


7.32 


4 


363 


0o980 


88.971 


7*68 


22 


385 


5.,392 


94.363 


8. 68 


23 


408 


5.637 


100.000 
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Attachment B-3 
(Page 12 of 23) 



AUSTIN INDEPENDENT SCHOOL DISTRICT FINAL REPORTS 

OFFICE OF RESEARCH AND EVALUATION SA-JF080 0101 

15:20 T 

ONE YEAR FOLLOW UP - 1986-1987 
SPANISH - DOMINANCE = A OR B OR C 
JRHI - TITLE VII 
GRADE=07 



STATUS 


FREQUENCY 


CUM 


FREQ 


PERCENT 


CUM 


PERCENT 


2 


65 




65 


9 8 0^-8 5 




98.485 


7 


1 




66 


1.515 




100.000 


DOMINANC 


FREQU ENCY 


CUM 


FREQ 


PERCENT 


CUM 


PERCENT 


A 


27 




27 


40.909 




40.909 


B 


29 




56 


43.939 




84.848 


C 


10 




66 


15.152 




100.000 


LEPYEARS 


FREQUENCY 


CUM 


FREQ 


PERCENT 


CUM 


PERCENT 


0.44 


2 




2 


3.030 




3.030 


0.6 


18 




20 


27.273 




30.303 


0.68 


t 




21 


1.515 




31.818 


1.32 


I 




22 


1.515 




33.333 


L.68 


16 




38 


24.242 




57.576 


2 


1 




39 


1.515 




59.091 


2.32 


1 




40 


1.515 




60.606 


2.68 


8 




48 


12.121 




72.727 


3 


2 




50 


3.030 




75.758 


3.68 


3 




53 


4.545 




80.303 


4.32 


1 




54 


1,515 




81.818 


5.68 


2 




56 


3.030 




84.848 


6.32 


I 




57 


1.515 




86.364 


6.68 


4 




61 


6.061 




92.424 


7.32 


2 




63 


3.030 




95.455 


7.68 


1 




64 


1.515 ■ 




96.970 


8.68 


2 




66 


3.03 0 




100.000 
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B 
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46 
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C 
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54 


14.815 




100.000 


LEPYEARS 
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FREQ 
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PERCENT 


0.44 


5 




5 


9.259 




9.259 


0.6 


10 




15 


18.519 




27.778 


1 


3 




IS 


5,556 




33.333 


1.32 


2 




20 


3.704 




37<?37 


1.68 


20 




40 


37.037 




74.074 


2.32 


3 




43 


5.556 




79.630 


2.68 


2 




45 


3.704 




83.333 


3 


1 




46 


1.852 




85.185 


3.32 


I 




47 


1.852 




87.037 


3.68 


2 




49 


3.704 




90.741 


5.68 


1 




50 


1.852 




92.593 


7.24 


1 




51 


1.852 




94.444 


7.68 


I 




52 


1.852 




96.296 


8.68 


2 




54 


3.704 




100.000 
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S A 
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I PPYPA ft ^ 






CD cn 


ncn CM T 
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1 
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1 


1.299 




lo299 


0.24 


4 




5 


5.195 




6.494 


0.32 


1 




6 


1.299 




7.792 


0,6 


2 




8 


2 .59 7 




10.390 


1.32 


2 




10 


2.597 




12.987 


1.68 


3 




13 


3.896 




16.883 


2 


1 




14 


1.299 




18.182 


2.68 


I 




15 


1.299 




19o481 


3 


3 




18 


3.896 




23.377 


3.32 


2 




20 


2.597 




25.974 


3.68 


8 




28 


10.390 




36.364 


4 


!■ 




29 


1.299 




37.662 


4.32 


I 




30 


1.299 




38.961 


4.68 


7 




37 


9.091 




48.052 


5«32 


1 




38 


1.299 




49.351 


5.68 


2 




40 


2.597 




51.948 


6 


I 




41 


l;299 




53.247 


6.32 


1 




42 


1«299 




54.545 


6.68 


15 




57 


19.481 




74.026 


7 


I 




58 


1.299 




75.325 


7.32 


1 




59 


1.299 




76.623 


7.68 


9 




68 


II0688 




88.312 


8.68 


9 




77 


11.688 




100.000 
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AUSTIN INDEPENDENT SCHOOL DISTRICT 
OFFICE OF RESEARCH AND EVALUATION 
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ONE YEAR FOLLOW UP - 1986-1987 
SPANISH « DOMINANCE = A OR B OR C 
JRHI - NOT TITLE VII 
GRADe=08 



15:20 THURSDAY 



STATUS FREQUENCY CUM FREQ 



2 


18 


7 


3 


DQMINANC 


FREQUENCY 


B 


9 


C 


12 


LEPYEARS 


FREQUENCY 


0.6 


1 


1.68 


2 


2 




3.16 




3.32 




3.68 




4.32 




4.44 




4.68 


. 2 


5.32 


2 


6.68 


1 


7.68 


5 


8.68 


2 



•CD cn 


PERCENT 


CUM PERCENT 


1 Q 

to 


85.714 
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14.286 


100«000 


FREQ 


PERCENT 


CUM PERCENT 


9 


42.857 


42,857 


21 


57.143 


100.000 


FREQ 


PERCENT 


CUM PERCENT 


1 


4.762 


4.762 


3 


9.524 


14.286 


4 


4.762 


19.048 


5 


4.762 


23.810 


6 


4.762 


28.571 


7 


4.762 


33.333 


8 


4.762 


38.095 


9 


4.762 


42.857 


11 


9.524 


52.381 


13 


9.524 


61.905 


14 


4.762 


66.667 


19 


23.810 


90.476 


21 


9.524 


1.00.000 
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B 
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49 
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c 


11 
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LEPYEARS 


FREQUENCY 


CUM 


FREQ 


PERCENT 


CUM 


PERCENT 


0. 16 


2 




2 


3.333 




3.333 


0.24 


2 




4 


3.333 




6.667 


0.44 


1 




5 


1.667 




8.333 


0.52 


1 




6 


1.667 




10.000 


0.6 


13 




19 


21.667 




31.667 


0.68 


2 




21 


3.333 




35.000 


1 


1 




22 


1.667 




36.667 


1.32 


1 




23 


1.667 




38.333 


1.68 


11 




34 


18.333 




56.667 


2.68 


3 




37 


5.000 




61.667 


3 


2 




39 


3o333 




65.000 


3^68 


7 




46 


11.667 




76.667 


4 


3 




49 


5.000 




81.667 


4.32 


2 




51 


3.333 




85,000 


4.68 


2 




53 


3.333 




88.333 


5.68 


2 




55 


3.333 




91.667 


6 


1 




56 


1.667 




93.333 


6.32 


1 




57 


1.667 




95.000 


6.68 


2 
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3.333 




98.333 


7.32 


1 




60 


1.667 




100.000 




122 

APPENDIX B 
37 



86.42 



Attachment B-3 
(Page 17 of 23) 



AUSTIN INDEPENDENT SCHOOL DISTRICT FINAL REPORTS 

OFFICE OF RESEARCH AND EVALUATION SA-JF080 OIOl 

15520 JH[ 

CNE YEAR FOLLOW UP - 1986-1987 
SPANISH - DOMINANCE = A OR B OR C 
SRHI - TITLE VII 
GRADE=10 



STATUS 


FREQU ENCY 


CUM 


FREQ 


PERCENT 


CUH PERCENT 


2 


40 




40 
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7 1 • DO 1 


7 


1 




41 


2.439 




inn nnrt 


DOM I NAN C 


FREQUENCY 


CUM 
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CUM 


PERCENT 


B 


32 




32 


78.049 




78.049 


C 


9 




41 


21.951 




100,000 


L.EPYEARS 


FREQU ENCY 


CUM 


FREQ 


PERCENT 


CUM 


PERCENT 


C 






I 


2.439 




2.439 


O.lnfir 






2 


2.439 




4.878 


0.24 






3 


2.43 9 




7.317 


0.6 


16 




19 


39.024 




46.341 


1 






20 


2.439 




48.780 


1.68 






24 


9.756 




58.537 


2 






26 


4.878 




63.415 


2.32 






27 


2.439 




65.854 


2.68 






30 


7.317 




73.171 


3.68 






34 


9.756 




82-927 


4 






35 


2.439 




85.366 


4.32 
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2.439 




87.805 


4.68 
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90-244 


5.68 
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8.68 


3 
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AUSTIN INDEPENDENT SCHOOL DISTRICT 
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FINAL REPORTS 
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5 
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1 


2 
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10.526 
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1.68 




14 
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73.684 


2.32 
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78.947 


5 




16 
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5.263 




94.737 


6.32 




19 


5.263 
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AUSTIN INDEPENDENT SCHOOL DISTRICT 
OFFICE OF RESEARCH AND EVALUATION 

ONE YEAR FOLLOW UP - 1986-1987 
SPANISH - DOMINANCE = A OR B OR 
SRHI - TITLE VII 
GRADE=12 



FINAL REPORTS 
SA-JF080 Olpl 



STATUS 
2 

DOMINANC 

B 
C 



0.6 

I 

1.68 
2.68 

3 

7.68 
8.68 



FREQUENCY CUM FREQ 



13 

FREQUENCY 

9 
4 



13 

CUM FREQ 

9 
13 



PERCENT CUM PERCENT 
100.000 100.000 
PERCENT CUM PERCENT 



69.231 
30.769 



69.231 
100.000 



LEPYEARS FREQUENCY CUM FREQ PERCENT CUM PERCENT 



3 
1 
3 
1 
1 
2 
2 



3 
4 
7 
8 
9 
11 
13 



23.077 
7.692 

23.077 
7.692 

7.692 
15.385 
15,385 



23.077 
30.769 
53.846 
61.538 
69.231 
84.615 
100.000 
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AUSTIN INDEPENDENT SCHOOL DISTRICT 
OFFICE OF RESEARCH AND EVALUATION 



FINAL REPORTS 
SA-JF080 0101 



ONE YEAR FOLLOW UP - 1986-1987 
SPANISH - DOMINANCE = A OR B OR C 
SRHI - NOT TITLE VII 
GRADE=09 

STATUS FREQUENCY CUM FREQ PERCENT CUM PERCENT 



2 
7 



A 
8 
C 



• 

0 

0.6 
0.68 
1 

1.68 

2 

2.68 
3.68 
A 

4.32 
4.68 
5.32 
5.68 
6.68 
7.68 
8.68 



31 
7 



COMINANC FREQUENCY CUM FREQ 



1 

24 
13 



LEPYEARS FREQUENCY 



1 

1 

4 

1 

1 

5 

2 

3 

2 

1 

1 

2 

2 

4 

2 

3 

3 



31 
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81.579 


38 


18.421 




100.000 


FREQ 
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2.632 
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65.789 


38 • 


34.211 




100.000 
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16>.216 
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17 
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45.946 
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5.40 5 




51.351 


20 


2.703 




54.054 


21 
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56.757 


23 
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62.162 


25 
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29 
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78.378 


31 


. 5.40 5 




83.784 


34 
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15:20 THl 

ONE YEAR FOLLOW UP - I986-I987 
SPANISH - DOMINANCE = A OR B OR C 
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100.000 


DQMINANC 


FREQUENCY 


CUM 


FREQ 


PERCENT 
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B 
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16 
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I 




17 


5.882 




100.000 
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PERCENT 


0.08 


1 




I 


5.882 




5.882 


0.24 


1 




2 


5.882 




11.765 


0.52 


I 




3 


5.882 




17.647 


0.6 


5 




8 


29.412 




47.059 


0.68 


2 




10 


11.765 




58.824 


2.68 


I 




11 


5.882 




64.706 


3.32 


2 




13 


11.765 




76.471 


4.68 


I 




14 
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5.32 


1 




15 
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88.235 


5.68 


I 




16 
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6.68 


I 




17 
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100.000 
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SPANISH - DOMINANCE = A OR 6 OR C 
SRHl - NOT TITLE VII 
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STATUS 


FREQUENCY 


CUM 


FREQ 
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CUM 


PERCENT 


2 


2 




2 
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100.000 


DOMINANC 


FREQUENCY 
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CUM 


PERCENT 


B 


1 




1 


50.000 




50.000 


C 


1 




2 


50,000 
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5.68 


1 




1 


50,000 




50,000 


7,68 


1 




2 


50.000 




100.000 
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AUSTIN INDEPENDENT SCHOOL DISTRICT 
OFFICE OF RESEARCH AND EVALUATION 



FINAL REPORTS 
SA-JF080 OIOI 



ONE YEAR FOLLOW UP - 1986-1987 
SPANISH - DOMINANCE = A OR B OR C 
SRHI - NOT TITLE VII 
GRADE=I2 



15:20 THURSDAY, 



STATUS FRECUENCY CUM FREQ 
2 1 I 

DOMINANC FREQUENCY CUM FREQ 
B . I I 

LEPYEARS FREQUENCY CUM FREQ 
1.68 I I 



PERCENT CUM PERCENT 

100.000 100.000 

PERCENT CUM PERCENT 

100.000 100.000 

PERCENT CUM PERCENT 

100.000 100.000 
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LA PRUEBA RIVERSIDE de REALIZATION en ES^aFoL 

Purpose 

La Prueba Riverside de Realizacion en Espanbl (Prueba Riverside) is a Spanish 
achievement test developed by Riverside Publishing which measures achievement 
in reading, language, mathematics, social studies, and science; it is designed 
to be of comparable difficulty to the ITBS. The highest possible raw score 
varies from 25 to 30, depending upon the subtest. La Prueba Riverside was 
administered to LEP students to provide information concerning: 

Decision ^estion Dl ; Should AISD adopt the Title VII Program Components 

when federal funding expires? 

Objective #4 - Spanish Proficiency: By the end of each project year, the 
percentage of project students exhibiting raw score gains on the language 
portion of the Prueba Riverside will be higher than that found In the previous 
year. (MQrchison and Travis only) 

Evaluation Question Did those project participants receiving 

Instruction in Spanish exhibit raw score gains in their Spanish 
language scores? (Murchison and Travis only)? 

Evaluation Question Dl-lO ^ Did the percentage showing raw score 
gains exceed that found last year? 

Objective #5 - Spanish Achlevenent: By the end of each project year, the 
percentage of project students exhibiting raw score gains in reading, 
mathematics, social studies, and science of the Prueba Riverside will be higher 
than that found the previous year. (Murchison and Travis only) 

Evaluation Question Dl-*11 ^ Did those project participants receiving 
instruction In Spanish exhibit raw score gains in their Spanish 
achievement scores? (Murchison and Travis only) 

Evaluation Question 01^12 ^ Did the percentage showing raw score 
gams exceecl tnat found last year? 



Procedure 

La Prueba Riverside was administered to Title VII LEP students at Murchison and 
Travis in the fall and spring of school year 1986-87. At Murchison, it was 
given because Title VII LEP students received bilingual instruction in the 
content areas plus ESL. At Travis, LEP students received one daily period each 
of Spanish for Native Speakers and .ESLi content areas were taught in English. 
In the casa of Travis, La Prueba Riverside wss administered to evaluate school 
achievement in the students* more fluent language. 
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The Prueba Riverside was administered to program students from September 25 to 
October 8, 1986* At Murchison seventh and eighth graders were given the test 
by TBE teachers* The bilingual teacher at Travis administered the Prueba 
Riverside to program students in grades 9 and 10* Schedules did not permit 
testing to be done by the Title VII evaluation associate* While it is not 
optimal to have the teachers administer the test,, they seemed to approach the 
task seriously and conscientiously* These results provided the baseline for 
comparison with April-May of 1987 re-evaluation scores* The pre- and posttest 
results for students who participated in the program for tvjo years were also 
analyzed for significant gains* 

Last year, the full time program specialist coordinated the testing* This year 
one full time program specialist was not hired; instead, program 
teacher/specialists were named at each school* Coordination of test 
administration was handled by the evaluation associate who conferred with the 
Title VII program teacher/specialists at Murchison and Travis* At Travis, one 
of the counselors also assisted* 

The following coordination problems occurred in the administration of La Prueba 
in the f.all* It is not known whether they affected test validity: 

• The teacher/specialists at Murchison and Travis were hard to reach 
directly so telephone messages were left* Many times this slowed 
down communicatioiw 

• Manuals were sent to the teacher/specialist at .Murchison on Thursday 
to arrive Friday for Tuesday fall testing* The teacher/specialist 
was to distribute them to the other teachers who would be testing* 
Teachers did not receive them until Monday* Thus, preparation time 
was minimal* 

e At Murchison a meeting was scheduled on the Monday prior to testing 
by the evaluation associate to review test instructions* Apparently 
there was some miscommunication, because teachers were not notified 
and therefore did not show up* The evaluation associate discussed 
testing with the teacher/specialist alone* 

t Make-ups were given to students by the evaluation associate at the 
request cf the schools* Her Spanish fluency was not perfect in 
terms of pace. However, students did seem to understand and worked 
without apparent problems* 

The Prueba Riverside posttest, administered between March 31 and April 27, 
1987, went relatively smoother* Teachers' manuals and student booklets were 
sent to both Murchison and Travis one week before testing* The posttest was 
also administered by the TBE teacher at Murchison and the bilingual ESL teacher 
at Travis* Additionally, make-ups were given by a bilingual clinical 
psychologist with an educational background* 
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Hispanic students in the bilingual and transitional programs at their respec- 
tive schools function with varying proficiency in two languages* Therefore, it 
was assumed that their Spanish fluency would generally not be as proficient as 
Spanish monolingual speakers* Subsequently, on the Prueba Riverside, students 
were assigned to a test level designated as "low average or below average*" 
The only exceptions to this were the tenth graders at Travis who were tested 
out of level because the test ceiling was ninth grade* Students were given the 
following levels: 



Because Prueba Riverside has only spring norms, students' raw scores were used 
to compare achievement gains* It should be noted, however, that during the 
first program year, 1985-86, seventh graders were mistakenly given level 13 in 
the fall. Thus, it should have been easier for them to show gains in the 
spring when given a lower level of the test* However, no unusual fluctuation 
in gains were noted; Murchison*s overall subject mean raw score gains were 
basically the same with or without seventh grade scores* 

Prueba pre- and posttest scores were keypunched and entered onto SAS data files 
SA-BYOOl-0104 and SA-BYOOl-0106 by the programmer analyst. In June, 1987, the 
program evaluation associate, assisted by ORE staff, modified an existing 
program, SA-BY003-0301 (Attachment C-1), to answer the foregoing decision and 
evaluation questions concerning student gains. 



Objective #4 - Spanish Proficiency: By the end of each project year, the 
percentage of project students exhibiting raw score gains on the language 
portion of the Prueba Riverside will be higher than that found in the ::revious 
year. (Murchison and Travis only) 

Evaluation Question Did those project participants receiving 

instruction in Spanish exhibit raw score gains in their Spanish language 
. scores? (Murchison and Travis only) 

As can be seen in Figure C-1, Title VII Program students at Murchison and 
Travis in grades 7-10 made highly significant (.0001) overall mean raw score 
gains in language in 1986-87* When examined by grade, program LEP students 
exhibited significant mean raw score language gains in three of the four grades 
tested. (See Figures C-2 and C-3*) It should be noted that the actual number 
of points gained pre- to post is fairly small. 



Grade 

8 

9 

10 



Level 

13 
14 
14 



Results 
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FIGURE C-1 

LA PRUEBA RIVERSIDE HEAtJ m SCORE GAINS 
OF TITLE VII PROGRAM STUDENTS 
AT ^a{RCHISON AND TRAVIS IN 1986-87 



SUBJECT 


N 


MAX SCORE 


MEAN PRt 


MEAN POST 


MEAN GAIN 


Reading 


146 


30 


17.30 


ii0.07 


2.76 


Language 


148 


25 


12.72 


14.47 


1.75 *** 


Mathematics 


148 


30 


16.24 


19.15 


2.91 *** 


Socia>l' Studies 


148 


28 


15.95 


17.77 


1.82 *** 


Science 


148 


28 


15.43 


17.11 


1.69 *** 



T tests were run to check pre- to posttest gains for significance. 
*** = Significance at or above .001 level 



FIGURE C-2 
GRADE LEVaS UITH SIGNIFICANT AND 
NOT SIGNIFICANT mUS ON LA PRUEBA RIVERSIDE — 1986-87 



SUBJECT 




NOT SISNIPICANT 


Keading 


/,a,9,10 




Language 


7,8,9 


10 


Mathematics 


7,8,9,10 




Social Studies 


7,9,10 • 


8 


Science 


7,10 


8,9 



Ga^'^s significant at p<.01 level or greater 



Evaluation Question Dl-lO . Did the percentage showing raw score gains exceed 
that found last year? 

Figures C-4 shows that the percentage of Title VII students at Murchison (72%) 
making Spanish language gains increased over 1985-86 (59%). At Travis there 
was a marginal decrease of one percentage point in 1986-87, Thus, in terms of 
both the evaluation question and the Spanish language objective, Murchison 
program students met the achievement criterion. These participants received 
one period of formal bilingual language instruction and on-going bilingual 
language support in other content areas, and ESL each day. Travis 
participants, who narrowly missed meeting the objective, received a daily 
period of Spanish for Native Speakers. 
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FIGURE C-3 

I A PRUEBA RIVERSIDE MEAN RAW SCORE GAINS ^ 
5f 1986-87 TITLE VII PROGRAM STUDENTS. 
BY GRADE 
(Page 1 of 2) 









TITLE 


VII 


PROGRAM 


$A-8Y003 030 


1 oZii 


McOriCdOAYt 


JUNE 24f 1987 8 








PRUE8A - 


PRE 


IFALL 1986) 


C A_ OVAA 1 

SA—oYOOl 


0104 














PkUEBA 


POST 


I SPRING 19871 


oYOOl 


OIOo 








VARIABLE 


N 


HEAK 


STANOARO 




MINIMUM 


HAXInUM 


CTA Co DAD 


U. V. 


T 


PR>|T| 








DEVIATION 




VALUE 

tmmmm GRA0Ps07 


VALUE 


OF MEAN 








'ft£AO 


46 


15.8125 


4.3254 




■ wAMWC 

7.0000 


24.0000 


0.6243 


27^354 


25V33 


070001 


REA02 


AS 


19.3333 


4.5210 




7.0000 


27.0000 


0.6526 


23.385 


29.63 


0.0001 


REAOG 


46 


3.5208 


4.1565 




-3.0000 


16.0000 


0.5999 


118.053 


5.87 


0.0001— 


'HANG 


'46 


11.6250 


3.4556 




5.0000 


20.0000 


0.4988 


29.726. 


2a;'3i 


OlOOOl 


LANG2 


46 


13.5208 


3.3069 




7.0000 


21.0000 


0.477: 


24.458 


28.33 


0.0001 


LANGG 


46 


1.8958 


2.5452 




«>4.0000 


9.0000 


0.3 674 


134.255 


5.16 


0.0001 — 


HATH 


¥6 


15.8750 


4.4941 




8.0000 


24.0000 


0.6487 


28.309 


'24.47 


0.0001 


HATK2 


46 


18.7917 


4.4048 




9.0000 


26.0000 


0.6358 


23.440 


29.56 


0.0001 


HATHG 


46 


2.9167 


4.8371 




•11.0000 


13.0000 


0.6982 


165.842 


4.18 


0.0001'— 


SOCST 


'46 


15.1250 


3.8016 




8.0000 


24.0000 


0.5487 


"25;'135 


"27:56 


'0^0001 


SCCST2 


46 


17.0000 


5.0781 




7.0000 


26.0000 


0.7330 


29.871 


23«19 


0.0001 


SOCSTG 


48 


1.8750 


4.3790 




-8.0000 


14.0000 


0.6321 


233.546 


2.^7 


0.0047 — 


"SC 


46 


13.4792 


3.8315 




6.0000 


21.0000 


0.5530 


28.~425 


24^37 


*o;ooor 


SC2 


46 


15.3750 


3.9174 




6.0000 


26.0000 


0.5654 


25.479 


27.19 


0.0001 


SC6 


46 


1.8958 


3.6800 




-d.oooo 


7.0000 


0.5312 


194.108 


.3.57 


0.0008^ 



X 

■■■■ « ^...^>. „ ■ ■ ■ GRA0E«08. 



'REAO 


53 


16.5283 


6.1193 


5.0000 


28.0000 


0.8406 


37^023 


19766" 


070001 


AEAD2 


53 


19.1321 


5.4774 


5.0000 


27.0000 


0.7524 


28.629 


25.43 


0.0001 


ftEAOG 


53 


2.6038 


3.5374 


-4.C000 


11.0000 


0.4859 


135.856 


5.36 


0.0001 


"LANG*" 


53' 


13.0189 


4.8575 


3.0000 


23.0000 


0.6672' 


'37.^312 


T9;5l 


070001 


LANG2 


53 


15.0377 


4.0948 


5.0000 


21.0000 


0.5625 


27.230 


26.74 


0.0001 


LANGG 


53 


2.0189 


3.5975 


-7.G000 


13.0000 


0.4942 


178.194 


4.09 


0.0002'^ 


•MATH" 


53 


16.4528 


4.2452 


7.00C0 


' 25.0000 


0.5831 


25.802 


28;21 


0.0001 


MATH2 


53 


18.1887 


4*8756 


7.00C0 


27.0000 


0.6697 


26.806 


27.16 


0.0001 


HATHG 


53 


1.7358 


3.9426 


-10.0000 


11.0000 


0.5416 


227.129 


3.21 


0.CJ23 ^ 


SOCST 


53 


16.1132 


4.8859 


4.0000 


25.0000 


0.6711 


30^322 


24;oi 


0.0001 


S0CST2 


53 


17.1887 


5.7481 


3.C000 


26.0000 


0.7896 


33.441 


21.77 


0.0001 


SOCSTG 


53 


1.0755 


5.5326 


-12.0000 


14.0000 


0.7 600 


514.434 


1.42 


0.1630 — 


SC 


■53 


15.0377 


4.5614 


5.0000 


24.0000 


0.6266 


30.333 


24.00 


'0.0001 


SC2 


51 


15.9608 


4.6474 


8.0000 


26.0000 


0.6508 


29.118 


24.53 


0.0001 


SCG 


51 


0.9412 


3.7916 


-8.0000 


11.0000 


0.5309 


402.861 


1.77 


0.0824 ~ 
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TITLE VII PROGRAH 

PRUEBA - PRE (FALL IS86» 

PRUEBA POST (SPRING 19871 

VARIABLE N HEAN STANDARD MINIMUM 

DEVIATION VALUE ' 



SA-BYOOa 0301 8:33 
SA-BYOOl 0104 
SA-BYOOl 0106 

HAXIHUH STO ERROR 

VALUE ' OF MEAN 



UEONESOAYt JUNE 24. 1987 9 
C.V. T PR>JT| 



GRA0E*09 — « 



REA'0 


26 


19.0385 


6.3968 


2.0000 


29.0000 


1.2545 


33.599 


1 5.18 


f\ "/inn t 


REA02 


26 


21.B077 


5.6144 


2.0000 


30.0000 


1. 1011 


25.745 


19.81 


0.0001 


REAOG 


26 


2.7692 


3.4329 


-2.0000 


X2.0000 


0.6732 


123.965 


4.11 


0.0004 


I'ANG 


26 


12;5385 


4.1591 


5.C000 


21.0C00 


. 0.8157 


33cl71 


15.37 


0.0001 


LANG2 


26 


14.5769 


4.0217 


5.0000 


22.0000 


0.7887 


27.589 


18.48 


0.0001 


LANGG 


26 


2.0385 


3.5494 


-3.0000 


15.0000 


0.6961 


174.123 


2.93 


0.007^. 


MATH 


'26 


15.5769^^ 


5.4712 


5.0000 


28.0000 


1.0730 


35.124 


14.52 


0.0001 


KATH2 


26 


19.1154 


6.1013 


3.00C0 


30.0C0C 


1.1966 


31.918 


1 5.98 


0.0001 


MATHG 


26 


3.5385 


4.4563 


-3*0000 


13.0000 


0.8739 


125.938 


4.05 


0.0004 . 


socsr 


26 


16. 1923 


4.8910 


4.C000 


26.0000 


0.9592 


30.205 


16.88 


0.0001 


S0CST2 


26 


• 19.3077 


4.3522 


9.G000 


26.0000 


0.8535 


22.541 


22.62 


0.0001 


SOCSTG 


26 


3.1154 


3.6258 


-6*0000 


11.0000 


0.7111 


116.383 


4. 3 8 


nn n o 


SC 


2'6 


17.730S 


4. 8626 


5.C000 


26.0000 


0.9536 


27.424 




n nn n 1 
O.OOOi 


SC2 


26 


19.1538 


3.8020 


11.0000 


27.0000 


0.7456 


19.850 


23.69 . 


n nnn 1 


SCG 


26 


i«4231 


3.6897 


— 4«0U00 


I I.UUUU 


U.I cso 


peg 


1 Qt 

1. 7 f 




RFAO 


21 


20.4762 


5.8874 


— — ^ GRA0E=10 
5.0000 


27.0000 


1.2847 


28.753 


15.94 


o'.oool 


REA02 


21 


21.9524 


6.0620 


6.0000 


29. COCO ' 


1.3228 


27.614 


16«59 


0.0001 


REAOG 


21 


1.4762 


2.3795 


-3.0000 


6.0000 


0.51V2 


161.190 


2.84 


0.0101 


CAN'a 


•21 


r4.7143 


3.8619 


8.0000 


22.0600 


0.8427 


26.246 


17.46 


'0.0001 


UHCZ 


21 


15.0952 


4.0361 


6.C000 


22.0000 


0.8808 


26.738 


17«14 


0.0001 


LANGG 


21 


0.3810 


4.4326 


-10.C0C0 


11.0000 


0.9673 


1163.548 


C.39 


0.6979 


KATH* 


2T 


17^3333 


5.56'0 


6.0000 


26.0000 


1.2137 


32.087 


14.28 


o;oooi 


MATH2 


21 


22.4266 


5.9462 


6.0000 


30.0000 


1.2976 


26.512 


17.29 


0.0001 


MATHG 


21 


5.0952 


4.9285 


-3.0000 


X7.0000 


1.0755 


96.728 


4.74 


0.0001 


soc'sr 


'21 


1770952 


5.2049 


5.0000 


27.0000 


1.1358 


30.446 


15.05 


O.QOOl' 


$CCSJZ 


21 


19^0952 


4.6358 


9.0000 


26.0000 


1.0116 


24.277 


18.88 


0.0001 


SOCSTG 


21 


2.0000 


3.9370 


-3.C000 


14.0000 


0.8591 


1C6.850 


2.33 


0.0305 




21 


18.0000 


4.8374 


4.0000 


23.0000 


1.0556 


26.&74 


X7.05 


O.OOOi 


SC2 


21 


21.3333 


4. 3742 


8.0000 


27.0000 


0.9545 


20.504 


22.35 


0.0001 


SCG 


21 


3.3333 


3.8123 


-2.0000 - 


14.0000 


0.8319 


114.368 


' 4.01 


0.0007 



MOY£; Tli£ I^R'OCEOURE MEANS USEO 3.18 SECONOS ANO 350K ANO PRINTEO PACES 8 TO 9. 



527 PROC OELCTE OATA « BARBFILl BAR8FIL2S DC001370 

NOTES THE PROCEDURE DELETE USEO 2.20 SECl'IOS ANO 284K. 
JHOTE; SAS USEO 358K MEMORY. 



NOTES SAS INSTITUTE INC. 
SAS CIRCLE 

p6 eojTsooo i o o 

CARY, N.C. 27511-8000 ioO 
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FIGURE C-4 

PERCENTAGE OF TITLE VII STUDENTS SHOHINS 
GAINS OH LA PRUE8A RIVERSIDE 



■ SUBJECTS 


MURCHISON 


mm 




N 


1985-86 1986-87 


N 


1985-86 


1985-87 


Reading 


75 


51% 


m 


12 


m 


m 


Language' 


75 


59% 


72% 


13 


54% 


53% 


Mathematics 


76 


67% 


65% 


13 


46% 


85% 


Social Studies 


76 


54% 


60% 


12 


75% 


62% 


Science 


76 


57% 


57% 


12 


42% 


76% 



Objective #5 - Spanish Achievesient: By the end of each project year, the 
percentage of project students exhibiting raw score gains in reading, 
mathematics, social studies, and science on the Prueba Riverside will be 
higher than that found the previous year. (Murchison and Travis only) 

Evaluation Question Dl-ll , Did those project participants receiving 
instruction in Spanish exhibit raw score gains in their Spanish 
achievement scores? (Murchison and Travis only) 

Overall, Title VII Program students made highly significant mean raw score 
gaiiis (p<.0001) in all content areas of Spanish achievement in 1986-87 (see 
Figure C-1). When mean raw score aains were examined by grade level; 16 of 
20 comparisons (including language) were significant (see Figure C-3). 

Evaluation Question Dl-12 > Did the percentage showing raw score gains 
exceed that found last year? 

In terms of both the evaluation question and the objective, the overall 
percentage of students making gains increased in every subject area (see 
Figure C-5). As can be seen in Figure C-3, Travis met the objective in all 
achievement areas. Murchison did in reading and social studies; the 
percentage remained the same in science and decreased slightly in 
mathematics in 1986-87 at Murchison. It should be noted that Murchison has 
had limited bilingual mathematics instruction over the past two years. 
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FIGURE C-5 

COMBINED PERCENTAGE OF TITLE VII STUDENTS 
WITH LA PRUEBA RAW SCORE GAINS 




Discussion 

Overall, Title VII students at Murchison and Travis showed combined 
significant mean raw score gains in Spanish language proficiency. When 
tested in Spanish, they also showed combined overall significant mean raw 
score gains in achievement. By grade, language and achievement mean raw 
scores revealed that 16 of 20 comparisons of gains were significant. 

The two objectives used to evaluate students' Spanish proficiency and 
achievement stated that ^^e percentage of Title VII Program students making 
gains Jn language and other content areas would be higher in 1986-87 than in 
1985-86. Murchison met the language objective and the achievement objective 
in two of four areas; Travis met the achievement objective in all content 
areas, narrowly missing it •'n language. 
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o 



VARIABLE 



READ 


47 


REA02 


47 


AEAOG 


47 


LANG 


^7 


LAN 02 


47 


LANG6 


47 


MATH 


47 


HATH2 


47 


HATHG 


47 


SOCST 


47 


S0CST2 


47 


SQCSTG 


47 


SC 


47 


SC2 


47 


SCG 


47 



READ 

REA02 

REAOG 

lANG 

UNG2 

lANGG 

HATH 

MATK2 

KATHG 

SOCST 

sees 12 

.SOCSTG 

SCG 

^' '(ct THE 

517 
518 



101 
101 
101 
101 
101 
101 
101 
101 
101 

ioi 

101 

lOi 
101 
99 
99 

PRCC£OURE 



HEAN 



19.6809 
21.8723 

2.1915 
13.5106 
14.8085 

1.2979 
16.3617 
20.5957 

4.2340 
16.5957 
19.2128 

2<»6170 
17.85X1 
20. 1277 

2.2766 



16.1881 
19.2277 

3.0396 
12.3564 
3168 

».9604 
16»1782 
' .4752 

2.2970 
15*6436 
17.0990 

1.4554 
14.2970 
15.6760 

l.'t040 
MEANS USEfl 3. 



PRCC SOR?; 

BY G^AOci 



TITLE VII PROGRAM 
PRUEBA - PRE CFALL 1986) 
PRUEBA - POST (SPRING 1987) 



SA-BY003 0301 

SA-BYOOl 0104 
SAoBYOOl 0106 



8:33 «EONESOAY, JUNE 24, 1987 



4^ 



STANDARD 
CEV lATlON 



6.1507 
5. 7545 
3.0477 
4.1330 
3. 9926 
4.0104 
5.5224 
6. 1949 
<.6868 
4.9985 
4.4328 
3.7630 
4.8003 
4.16B3 
3.8261 



6! 



5.3286 
^•0217 
3.8521 
4.2662 
3.7998 
3. 1270 
4.3529 
4,6446 
4.4080 
4.4104 
5.4139 
5.0090 
4o2815 
4.2972 
3.7'96 
SECONDS AND 



MINIMUM 
VALUE 



MAXIMUM 
VALUE 



SCH00L=«007 



2.0000 
2.0000 
-3.0000 
5.0000 
5.0000 

-10.0000 
5.0000 
3.C000 

, -3. COCO 
4.0000 
9.0000 
-6.C000 
'V.COOO 
8.0000 
-4.C000 



29.0000 
30.0000 
12.0000 
22.0000 
22.0000 
15.0000 
28.0000 
30.0000 
17.0000 
27.0000 
26.0000 
14.0000 
26.0000 
27.0000 
14.0000 



SCHOOL* 052 — — 



5. G000 

5r0000 

-4.0000 

3.0000 

5oOOCO 
-7.0000 

7.0000 

7.00GQ 
-11.0000 

4.C000 

3.0000 
-12.0000 

5^0000 

6. C000 
-8-0000 

?5CK AND PRINTED 



28.0000 
27.0000 
16.0000 
23. 0000 
21.0000 
13.0000 
25.0000 
27.0000 
13.0000 
25. 0000 
26.0000 
14.0000 
24. 0000 
26.0000 
11.0000 
PAGE 7. 



STD ERROR 
OF MEAN 



0.8972 
0.8394 
0.4446 
0.6029 
0.5824 
0.5850 
0.8055 
0.9036 
0.6836 
0.7291 
0.6466 
0.5496 
0.7002 
0.6080 
0.5581 



0.5302 
0.4997 
0.3833 
0.4265 
0.3781 
0.3112 
0.4331 
0.4622 
0.4386 
0.4389 
0.5387 
0.4984 
0.4260 
0.4319 
0.3768 



C.V. 



31.252 
26.309 

139«071 
30«590 
26.961 

308.998 
33^752 
30.078 

110.692 
30.119 
23.072 

143.981 
26;891 
20.709 

168.063 



32.917 
26.117 

126.729 
34.688 
26.541 

159.511 
26.906 
25.139 

191.902 
28.193 
31.662 

344.159 
29.946 
27.411 

267.059 



21.94 
26.06 

4.93 
22.41 
25.43 

2.22 
20.31 
22.79 

6.19 
22.76 
29.71 

4.76 
25.49 
33.10 

4«08 



30.53 
38.48 

7.93 
28.97 
37.87 

6.30 
37.35 
39.98 

5«24 
35.65 
31.74 

2.92 
33.56 
36.30 

3.73 
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0.0001 
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VALUc 
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VAR READ 
LANG 
HATH 
SCCST 
SC 

BY SCHOOL; 



READ2 

LANG2 

HATH2 

SDCST2 
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RE ADG 
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MATHG 
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SCG; 



PRT; 



0C001190 
00001200 
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00001260 
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ENDORSEMENT TEACHERS 



Purpose 

Questions were included in tne discrictwide survey for teachers and 
administrators of Title VII program student participants. Responses provided 
information concerning the following questions: 

Decision Question Dl ; Should AISD adopt the Title VII Program 

Components when federal funding expires? 

Objective #6 - Activities: Major components will be implemented as planned in 
1986-87. 

Evaluation Question Dl-15 , How many teachers completed 1, 2, 3, and/or 
4 Classes in tne endorsement series? What were tne teacners' subject 
areas? What was the cost per teacher? 

Evaluation Question Dl-16 , Did hign school teachers participating in 
the ESL endorsement training program demonstrate improvement in specific 
comnetency areas? 

Evaluation Question Dl-17* How many LEP students were placed in the 
classes of endorsement participants? How many were not? 

Objective #3 - English Achievement—Students of Endorsement Participants: By 

the end of each program year, average posttest percentile scores in 
appropriate subject areas on the ITBS or TAP will be higher than average 
pretest scores for project students in the classes of ESL endorsement 
participants. 

Evaluation Question Dl-8 . Did program students in classes of teachers 
participating in the endorsement program exhibit higher average posttest 
than pretest percentile scores? 



Procedure 



A description of the data analysis used is given in the Results section. 
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Results 

Objective #6 - Activities; Major components will be implemented as planned In 
1986-87. 

Evaluation Question Dl-15 > How many teachers completed 1, 2, 3, and/or 
4 cUsses in the endorsement series? What were the teachers' subject 
areas? What was the cost per teacher? 



Endorsement Classes 

Hand tallying of enrollment lists provided by instructors were used to provide 
the following information about endorsement implerr^entation: 

9 This year 14 program teacners enrolled in the third ESL course and 
seven enrolled in the fourth and final ESL endorsement course (five 
finished the fourth course). A few of those enrolled in ESL series 
classes were not teachers at the four program schools. 

6 Three teachers completed all four courses offered in 1985-86 and 
1986-87 leading to endorsement. 

e Threft courses were finished oy five teachers and six completed two 
courses. One course was finished by 11 teachers. Thus, 25 teachers 
were involved o*'eralK 

e The three teacners completing all four endorsement courses instructed 
students in: 
Language 
Social Studies 
Vocational Arts 

0 Teachers completing two or more courses served students in; 
Reading Social Studies 

Language Science 
Mathematics Art 

• The total cost to Title VII for tne tuition of tne 21 program 
teacners who enrolled in the two endorsement classes in 1986-87 was 
$4,235, or $201.67 per endorsement participant. 

Evaluation Question 01-16 . Did high school teachers participating in 
the ESL endorsement training program demonstrate improvement In specific 
competency areas? 

The five AISD teachers who finished the last course were asked to complete a 
survey (see Attachment D-2) developed by the evaluator and eviluation 
associate for use during tne first program year. Surveys wich six new 
questions were given to the participants, three of whom were program teachers 
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who finished all courses in the ESL endorsement series. The following was 
expressed by these teachers: 

0 Of the five teachers, four responded they had learned "a lot" from 
the last class; one stated that "some" learning had occurred. 

0 Four of the teachers indicated the ESL courses were worth their 
expenditure of time — one did not. 

G While two teachers believed endorsement class participation had 
improved their LEP students' English skills; two were more neutral. 
One did not have any LEP students. 

Complete results can be found in Attachment D-2. 

Evaluation Question Dl-17> How many LEP students were placed in the classes 
of endorsement participants? How many were not? (by school). 

The programmer analyst created a SAS program^ SA-BY004 0401, to calculate the 
number of LEP students served by teach&rs who had completed two or more 
endorsement courses in 1985-86 or 1986-87 (see Attachment D-1). It was felt 
that teachers enrolled in more than one course were more likely to use ESL 
techniques enough to have a measurable impact on students' learning. Overall, 
98 students were served. (See Figure D-1.) Of course, other students were, 
or will be, impacted somewhat — those served by teachers participating in one 
endorsement class, non-LEP students, and students to be served in coming years 
by all endorsement teachers. However, in terms of program students, most of 
those served were at Travis where five teachers completed two or more 
endorsement courses. Most Travis students were taught by one of two ESOL 
teachers. She was bilingually endorsed through a grandfathvf clause in the 
state law and took the courses to formalize her training. 



FIGURE D-1 
TITLE VII STUDENTS SERVED BY 
ENDORSEMENT TEACHERS IN 1986-87 



School 


Number Served 




7 


8 


9 


10 


11 


12 


Total 


Murchison 


1 


0 


0 


0 


0 


0 


1 


Anderson 


0 


0 


2 


0 


•0 


0 


2 


Johnston 


0 


0 


10 


0 


0 


0 


10 


Travis 


0 


0 


39 


27 


14 




85 


Total 


1 


0 


6i 


27 


14 


5 


98 



Includes 14 teachers in two or more endorsement courses 
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Objective #3 - English Achievenent—Students cf Endorsenent Participants: By 
the end of each project year, average posttest percentile scores in 
appropriate suoject areas on the ITBS or TAP will be higher than average 
pretest scores for project students in the classes of ESL endorsement 
participants. 

Evaluation Question Dl-8 > Did program students in classes of teachers 
participating in the endorsement program exhibit higher average posttest 
than pretest percentile scores? 

As can De seen in Figure D-1, the vast majority of the students served were at 
Travis (85 of 98). Most of these students were instructed by one ESL teacher 
who was already bilingually endorsed. Thus, the effect of the training for 
her was impossible to separate from the effect of the overall program. 
Therefore, composite results show the trends seen at Travis High. While other 
endorsement participants did not serve enough program LEP stuaents to validly 
analyze, it should be noted that endorsement teachers impacted other students, 
too. LEP students of different language backgrounds and non-LEP students in 
the classes of these teachers oenefited to the extent that ESL training was 
general izaole to all . 
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S A S LOG VSE SAS 62«4 



VSE 3*1 JOa EV1SAS6V 



MOTEt THE JOB EVlSASBf HAS 6EEH aiN CNOER AELEASE 62«4 SAS 
AT AUSTM iNOEPENOEf^r SCHOOL OtSTfttCT 1 01986001 1. 



13S59 fUBSOAYt JUME I69 l9dT 
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MOTEs CPUtO VEJlStOfl « SERIAL « 013553 ffiUlEL « 43U • 
NOfEs MO QPTtCNS SPECIFtEC. 
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OPTIONS ERRORS « 01 

OPTIONS OSS « 0 NOREPLACE; 

TtTLEl 'AUSTIN INOEPEhOENT SCHOOL DISTRia 
TtTLE2 •OFFICE OF RESEARCH AND EVALUATION 
TITLED AOO MUK8ER OF C(H)RSES WITH EHOCR TEACH TO 



DATA FRVLABlt 



READ TITLE VII 19e6»B7 lUSTER FILE 



13 


INPUT STUIO 




l«7 


14 


STUNANE 
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19 
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16 
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$- 
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17 


STAfUS 


% 


42 


12 
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% 


43 


19 
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20 
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21 


ENOCRSE 




51 


22 


TUfREAD 


% 


53 


23 


TUTLANC 


% 


54 


24 


TUTMATH 


$ 


55 


25 


TUTSOCST 


% 


56 


26 


fUTSC 


% 


57; 



27 



CAROS; 



00000141^ 
OOOOOISG 
00000160 
00000170 
TITLE VII«< 00000180 
SA-BV004 0401«; 00000190 
TITLE VII MASTER FILE; 00000200 
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00000220 

• O0QO0230 

0C000240 

00000?.50 
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00000270 
00000280 
00000290 
00000300 
00000310 
00000320 
00000330 
00000331 
00000340 
00000350 
0C000360 
00000370 
00000360 
0C000390 



NOTES INVALID OATA FOR FALLLAQ IN LtNE 26 45«46. I9s31 
NOTES INVALID OATA FOR SPRCLAB IN LINE 26 48»49. 20231 
NOIEs FURTHER ERRORS OF THIS TYPE WILL NOT BE PRINTED. 
OPTIONS ERR0R$»NN; • LIMIT REACHEO. 

RULES 1234567 101^34567 2012^4567 301234567 401*234567 501234567 601234567 701234567 60 

26 60006ALEHAN LINDA S 00309 2C • • 0010 

STU1D«60006 STUNitH "ALEHAN LINDA S SCHOOLaOOS GRAOE-09 STATUS«2 O0NlNANC»C FALLLA6«. SPRCLAB-. ENDORSE* 

TUfREAD* rUTUNC" lUTMATK" TUTSOCST* TUTSC- .EftROR.«l .N.«l 

NOTES OATA SET MSEROIO.FRYLABI HAS 266 OBSERVATIONS ANO 14 VARIABLES* 106 OBS/TRK. 
NOTES THE OATA T^TATENENT USED 12.4a SECONDS ANO 322K. 



294 

295 
296 
297 
298 
299 
300 



PROC SORT! 
BY STUlOt 
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WARNINGS SORTSIZE VALUE IS LESS IHAN ^H^ ItlNifiUH 
REQUIRED BY YOUR SYSIEH SORI UllilTY* 
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S A S LOG VSC SAS 02.4 



VSE 3.1 JOB EVISASBV 



«nw«: UritlTlr MAY TEfiNINITE A8WMMALLV. 



I3SS9 TUCSOAV* JUNE 16» 1967 



301 

S02 



DATA FRVLAB2t 

SET FRVEIiOl 



fRVEN02 FRVEN03t 



30."^ 
304 
30S 



PROC SORT; 

BY STUlOt 



UARNINCt S0RTS12E VALUE IS tESS THAN THE HlMWH 

aEQUIREO BIf VOUft SYSTEM SORT UTILITY. 
tinw«= OTILHtf NAY TERMINATE ABNORMALLY. 

SSII' Sil^ USER0l0.f*YLAB2 HAS 2164 OBSERVATIONS ANO I VARIAfti ES 
NOTES THE PROCEOURE SORT tSEO 4f .53 SECONOS ANO 292^ VAKMBtfcS 



. 666 OBS/TRK. 



DATA fftYLA33; 

SET FRYLA02; 
BY STUlO; 
if FIRST. STUlO 
ENOuRSE ♦ |{ 
IF LAST.SfUiO 



THEN ENDORSE « 0} 
THEN OUTPUT; 



306 
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309 
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311 
312 
313 

NOTE; DATA SET USEROlO.f RYLAfl3 HAS 1529 OBSERVATfONS ANO 2 VARIABLES 
N0TE5 THE DATA STATEMENT LSEC 7.90 S6C0NOS So ioScf VARIABLES. 

3H OATA FRYLABIS 

MERGE PRYLABl UN 
fit FRYLAB3 ||N 

317 BY STUIOS 

3U IP PRYINI; 
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PROC SORTt 
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HQllt ?mJ P^nLnnaS^JS^t^yiiS* OBSERVATIONS ANO 14 VARIABLES 

HOTEt THE PROCEDURE SORT USED 27.31 SECONDS AND 292K. 
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S A S LOG VSE SAS 32.4 
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VSE 3,t JOB EVtSASBY 
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$ 43*45 
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^ACC SOAfi 

av scHooti 
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ttOIEt 04IA SET USEftOIO.gVLOCAT MS 294 OOSWVATIcJs AMD 2 VARIABLES 
JeOTEs THE PROCEDURE SCRlT USEC 40.49 SECONDS AND 292k! ^^^'ABLES. 

DATA fRVLABU 
^'30 HEncC j^RVlABl 
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*32 BY SCMOLS 
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244 OBS/TRK. 
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MOTES THE PR0CE3URE C6LET6 USED 2.04 SECONDS AND 2C4IC. 
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Attachment D-2 
(Page 1 of 2) 



Name 

School 



Teacher Self Inventory 

Please circle your response to the following questions regarding instructional 
materials using the scale below. 

. Strongly Agree Agree Neutral Disagree Strongly Disagree 
I ■ ' Z 3 4 5 

1. I feel prepared to teach LEP students. 

2. I am comfortable teaching my content area to LEP students 

3. I am able to elicit class participation from my LEP 
students. 

4. I am able to respond to LEP students' language needs. 

5. My present organization of instruction is adequate to meet 
the needs of- LEP students. 

6. I can adequately help mv LEP students stay 
on task. 

7. My instruction of tho content area is relevant to and 
useful for LEP students. 

8. I can adequately design objectives appropriate for the 
needs and achievement levels of my LEP students. 

9. I can utilize audio-visual equipment effectively to 
augment LEP student learning. 

10. I employ varied and student-appropriate evaluation 
strategies when assessing my LEP students. 

11. In terms of my instructional objectives, I am able to 
individualize activities appropriate for the special 
needs and achievement levels of my LEP students. 

12. I employ a variety of strategies to clarify 
instruction (e.g. modeling, audio-visual examples,, 
whole group responses, etc.). 





// 
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/ /// 
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/ 






1 2 . 
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3 
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N.R. = No Response 
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13. How many ESL endorsement classes have you taken? 
1 2 3^4 



14. How much do you feel you learned from this course? 

A lot / Some A little ^Nothing ^ — 

15. What were the most important skills and/or concepts you learned in this 
course? 

Teacher A: The difficulty that non-English students might have in 
learning English 

Teacher B: This course is a good preparation for assessment of learners' 
skills, phonology, morphology, culture teaching, and culture. 
Teacher C: Techniques on dealing with LEP students 

Teacher D: Practical application, learning, and basic linguistic data, too 
Teacher E: Awareness 

16. How would you improve the endorsement series ? 
Teacher A: No comment 

Teacher B: Keep the courses and the teaching assignment as close as 

possible. 
Teacher C: No comment 

Teacher D: Better instruction at entrance level 
Teacher E: No comment 

17. The skills I acquired during my ESL class(es) were helpful enough to 
justify the amount of time I devoted to classwork. //// Y es / N o 

18. As a result of my participation in the endorsement classes, my students 
improved in English skills. (Please circle one of the following:) 

/A. Strongly agree D. Disagree 

- /B. Agree E. Strongly disagree 

/C. Neutral / F. I don't have any LEP students. 
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ADMINISTRATOR INTERVIEWS 



Purpose 

Administrator interviews were conducted by the e.iluator to provide information 
concerning: 

Decision Question 01: Should AISD adopt the Title VII Program 
components when federal funding expires? 

Objective #6 - Activities: Major components will be implemented as 
planned in 1986-87r 

Evaluation Question Dl-8. What concerns/strengths about the 
implementation of the program were identified by: 

a) Program administrator? 

b) Campus administrators? 



Procedure 

To address the evaluation questions associated with the Title VII Program 
implementation and effectiveness, interviews were conducted with the program's 
administrator and campus* administrators, together with the LEP teachar 
specialist who coordinates the Title VII Program at their schools. A**! 
interviews were conducted by the proi,ram's evaluation associate in the offices 
of the staff. 

Parallel interview forms for campus and program administrators were developed 
by the ORE staff to guide the interviews as shown in Attachments E-1 and E-2. 

From March 26 to May 12, 1987, campus admini strati rs and LEP teacher 
specialists were interviewed at the four program schools; at one of the 
schools the administrator and LEP teacher specialist were interviewed 
separately. The program administrator was interviewed on May 12, 1987, in the 
District Office of AISD. 

Notes from the four campus interviews were paraphrased by the evaluation 
associate and recorded on a composite interview questionn, ire (Attachments E-1 
and E-2). Confidential ity was provided by designating the campus interviews 
by "school number" and recording the program administrators* responses 
together. 
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Results 

Objective #6 - Activities: Major components will be implemented as planned in 
1986-87. 

Eval uation Question Dl-8 . What concerns/strengths about the implementation of 
"We program were identified by: 

a) Program administrator? 

b) Campus administrators? 

Campus Administrator Interviews 

In general, the schools' administrators believed tnat Title VII was having a 
positive overall impact. Specifically, most noted improvement in: 

9 LEP student attendance, 

« Self concept of LEP students, 

• Coordination between ESL and content area teachers, and 

• Acquisition of English language skills and academic content of 
achievement of LEP students, 

However, in regard to the four program components: 

0 Opinions wert mixed concerning the staff development component. 
Whereas two of the four schools' administrators and LEP teacher 
specialists believed that it was "completely" or "mostly" successful, 
two interviewed staffs stated that it was "somewhai" successful. 

s Three schools' interviewed staffs judged the tutor component to be 
"completely" or "mostly" successful. The administrator and LEP 
teacher specialist at a fourth school held differing opinions; while 
one member stated that the tutor component was "mostly" successful, 
the other believed it was only "somewhat" successful, due to fewer 
available tutors second semester. 

© Opinions varied concerning the curriculum development component. One 
school's administrator and LEP teacher specialist stated that it was 
"completely" successful, and three interviewed schiools' staffs 
believed it to be "somewhat" successful. A fourth school's 
administrator and LEP teacher specialist differed; one judged the 
curriculum component as "not at all" successful while the other 
stated, "I don't know." 

• Similarly, feedback about the success of the parent worksnops 
component varied. Two of the schools judged this component to be 
either "completely" or "mostly" successful. One school stated, "I 
don't know." An interviewed staff at one school differed; while one 
member believed that the parent workshop component was "mo tly" 
successful, the second member stated, "I don't know." 

Complete results are shown in Attachnient E-l. 
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Program Administrator's Interview 

The program administrator saw the Title VII Program as having a definite 
impact. Specifically, her opinions include: 

More effective techniques of endorsement teachers are contributing to 
decreasing the dropout rate of LEP students. 

Endorsement teachers are using a natural approach in instructing LEP 
students. They are drawing upon a variety of carefully selected 
materials so that read"'ng levels are more appropriate and fewer new 
concepts are introduced at one time. 

Parent workshops, conducted by a bilingual clinical psychologist, are 
impacting LEP students through counseling of the students' families. 
Cooperative learning workshops were very successful, although teacher 
participation was limited. 

Tutoring assistance, which was off to a good start last year, worked 
out even better this year. 

Title VII 's success has contributed to the nomination of AISD for a 
state academic award. 

The program administrator made these recommendations for modifications or 
improvements: 

e The tutor program should be maintained, and If possible, more tutors 

should be added. 
9 Parent workshops should continue with little modification.' 
d Cooperative learning workshops should continue, 
e The ESL endorsement component is be^^ng considered for deletion. 

Complete results are shown in Attachm'int E-2. 

rfhereas both program administrator and interviewed school's staffs believe 
that Title VII is having a positive overall impact, especially in reducing the 
dropout rate, opinions are mixed on the effectiveness of the four components. 
To some extent, general conunents reflected the impact of both the regular 
Transitional Bilingual Education and ESL programs and the Title VII Program. 
Observations are particularly positive at those schools which have larger 
nispanic LEP populations, more teacher participants in training activities, 
and/or had university tutoring assistance for two semesters. Tutor ratings by 
the interviewed administrators and LEP teacher coordinators were impacted by 
the fact that schools wanted more tutors. Interviewed staffs also suggested 
that the tutors receive more training and that more information about how to 
use tutors be provided. However, most of the interviewed staffs' comments 
concerning tutors were positive. 

Comments of the administrator/LEP teacher specialists and the program 
administrator were re-examined in terms of the stated objective that major 
co»r.ponents would be implemented as planned. The opinions of interviewed 
personnel do not indicate problems in implementation of the staf^ development 
or curriculum development component, although other concerns were expressed. 
Regarding the tutoring component, the four schools' dp " 2 for additional 
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tutors may be more reflective of the success of this component than of a 
problem in implementation. Also, in co^isidering the implementation of the 
parent workshops component 5 parent attendance may have been hindered by the 
location of the workshops. A suggestion given at one of the schools is that 
meetings be held in the residenti .1 neighborhoods of Title VII program LEP 
students. 
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Campus Administrator Interview Questions 

How many of your teachers are involved in Title VII through tutors, 
endorsejsent ql asses, workshops, curri'^.dliEi development? 

Hone l'-15(#) // >lfjL I don't know 



#1 Close to 15. 

#2 (A) Two or more, but I'm uncertain. 
(B) Around nine. 

#3 Seventeen or more. 

#4 Overall about 25. 

How well have endorse!sent teachers ii^lemented Title VII \ ^gram 
objectives with LEP students in terras of successes or problems in the 
following: 

Adapting the content areas to ci^t the needs and levels of the LEP 
students? 

#1 TBE (Transitional Bilingual Education) teachers are doing a 

great job.' Student progress failures are rare. In fact, the 
teachers have experienced no problems here. 

#2 (A) One teacher is doing very creative things with writing at 

different levels, while one is doing detailed task analysis and 
adapting materials for different levels. 

(B) They are very conscious of the needs of LEP students, and this 
is being translated into adapting the content areas, \.e., 
simplifying materials by maP.ng them more understandable for 
all LEP students (although most are Hispanic). Soire problems 
are that materials are way to difficult and/or students 
sometimes cannot follow teachers who are going too fast. 

#3 They have been successful because of the checking of the LEP teacher 
specialist. Most stadents are passing, because Title VII is placing 
more emphasis on LEP students. The tutors have impacted here, too. 

#4 Title VII has really helped make the endorsement teachers more aware 
of specific needs of LEP students. Specifically, it has made them 
more comfortable with LEP students, while making them more receptive 
to new ideas and the special needs of these :>tudents. 

*At one school J;he administrator (A) and teacher specialist (B) were 
interviewed separately. 
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Developing appropriate and varied strategies for evaluation of LEP 
students? 

#1 TBE teachers do evaluate students differently. They use 

Chicano students to do some oral translating of test materials 
for LEP students. However, it is a problem for some teachers o 
This is also true in mathematics, because for the past two 
years we have not had a bilingual teacher. 

#2 (A) I don't know if application of what was learned in 

endorsement classes is being carried over in the classroom. 

(B) They are using other resources, i.e., having the students 
put together a collage and come up with a theme in 
language arts, demonstrating directions or perfonr-ance in 
sports and following up with a written test. 

#3 They are using group strategies, peer tutors, tutors, and 
cooperative group learning. It is important for all teachers 
to take workshops. 

#4 Yes, they have done that,, too. One (teacher) *does it orally, 
one-on-one. The ESOL teacher preps LEP student, before tests 
so that tney are able to do better. One (endorsement teacher) 
does an excellent job in givino explanations. Endorsement 
teachers are working more cooper?^tively with the ESOL teacher 
on testing. Tutors are being used to assist stu^^^^sits taking 
tests. 

Decreasing the dropout rate of LiEP students? 

#1 At this level this is true. We have only lost two students and 
one came back. Hispanic peers help keep kids in school. 
Evaluators haven't looked at social factors. 

#2 (A) In one of the teacher's classes there is a positive 

attendance trend, but the teacher has a special education 
background anyway. 

(3) Yes, we are keeping more LEP students. Generally dropouts 
are the ones who "have it" but don't have support. We 
don't investigate why they are not coming. With LEP 
studento there is more follow-up. More dropouts are 
non-LEP. 
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#3 All the LEP students are back, exceeding expectations* Those who 
drop out do so due to financial reasons. We try to keep those by 
1/2 day school/ 1/2 day work programs. 

#4 This is difficult to measure. Generally speaking, they've 

(endorsement teachers) had a lot more impact, basically oecause they 
care. 

Oe^nstrating increased cosspetency in instruction of LEP students? 

#1 You can't separate Title VITs impact. They (endorsement teachers) 
are getting competent just from experience. Tutoring and staff 
development have had an effect, but it is hard to separate. 

#2 (A) One teacher is. 

(B) Yes they are, based on talking with them in the classes we have 
together and working with the same students in various 
subjects, i.e., ESOL, Home Economics, reading, etc. 

#3 Yes, this has been seen in the ability to pass the TEAMS testing. 
All but one of the seniors passed, and even this student passed 
mathematics. 

#4 Of course. There is no doubt. For example, teachers attending the 
cooperative learning workshops have become more aware and are 
starting to internalize learning based on their own ideas and 
experiences. They are able to share this. 

Do you feel Title VII has iiapacted LEP tudent attendance? 

Yes//// Ho 

CoQsi^nts: 

#1 They are here every day. We won the attendance award at the junior 
high level. We're 30 percent LEP. In October we averaged 4 to 5 * 
absences (LEP) per week. 

#2 (A) No coimient. 

(B) Students show a high interest, sense of ccmmitment, 

responsibility to De here, to learn. Their curiousity is very 
high. 

#3 Absolutely. If not, all students would be dropouts. It has created 
an awareness of and opportunities for LEP students. 

#4 No doubt. The teacher makes all the difference in the world. We 
also 'e a gre.t LEP coordinator who is very sensitive to students. 



165 

APPENDIX E 
8 



Attachment E-1 
(Page 4 of 10) 



In j^ur opnion, has Title VII positively iBipacted the self-*concept 
and school attitude of LEP students? 

Yes, A Lot To Som Extent Not At All 

1 '4 /, Vx 3 

CcKis^nts: 

#1 The students already have a positive self-concept dus to 
participation in sports. 

#? (A) If concepts of endorsement were being carried out, it 
would have a positive impact on self-concepts. 

(B) They are baginning to feel a part of the school se'^ing, 
not left out, but positive about themselves and their own 
background. The learning of English still remains a 
tremendous challenge. 

#3 This is demonstrated ty their participation on the soccer team 
and in the mariachi band and Ballet Folklorico. 

#4 LEP students would be totally lost without it— lost in the 
• shuffle, forever dropouts. I don't think there is a student 
in one of my classes that walks down the hall and doesn't feel 
proud of himself. This is a change from the past. 

In your opinion, what impact has Title VII had upon the accpiisition 
of English language skills and acaueoic content achiev^nt of LEP 
students? 

#1 It has had a positive effect. The training and tutors have 
helped. Materials are another thing. LEP students are 
learning a little bit more. 

#2 (A) A double dose of English does help them make a transition. 

(3) Yes, there has been an impact, aspf\cially in oral 

communication skills, but there is still a long way to 
go. We need to zero in more on the problem to help them 
learn the most important things first, i.e., expanding 
vocabulary, writing complete sentehces, learning the 
mechanics of writing paragraphs, etc. It ;s not an easy 
thing to tell students to use English all the time. You 
must repeat it over and over again. 
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#3 There has been a relative increase in LAB scores from pre-to 
posttesting. The ESOL teacher emphasizes verbalizing. Also, 
two LEP students were NABE (National Association of Bilingual 
Educators) theme writing finalists on the topic "Why a Person 
Should Be Bilingual." 

#4 Teachers are now sending over materials to the ESOL teacher so 
she can prepare the students. Everyone is cooperative, 
helpful. It would have been interesting to track the gains of 
LEP student newcomers from grade 9 to 12. 

Hhat coordination are you a^are of that has occurred among ESL and 
content area teachers? 

Has it iBiproved? Yes ^^^^^ Ho Sa-^c 



Is it adequate? Yes^^^ "o^J^ 
Cements: 



#1 Coordination of materials, testing, supplies. All workshops 
are announced. The TBE teachers work through other content 
area departments; they are not isolated. Staff development 
has allowed teacher to mix informally. 

#2 (A) Supposedly, students are bringing in assignments and 

getting help with it. I've seen some contact, between. the 
ESOL teacher and other teachers in content a^eas. More 
is needed. 

(B) I've been able to share more because of endorsement 

classes. Teachers are asking all the time. They're not 
reticent, but isk what they can do or try. Content 
materials cou'jd be made more accessible by locating them 
in the library for checking out. 

#3 However, it does make a difference. It's even more than 
adequate. 

#4 It's been a matter of increasing it. The first year you don't 
know everyone. The ESOL teacher had to pave the way," like 
selling a product. The ESOL teacher helps students with other 
content area work one day a week (tries to keep it to one day 
a week!)* 
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7. Did any prob1ra(s} occur which could impact Title VII program 

outcooes on your casspus (teacher ratings, achievement of students}? 

#1 No. 

#2 (A) There are internal problems in campus personnel that are 
impeding the Title VII program. The teacher is currently 
on a professional growth plan, 

(B) This is my first year as a teacher specialist. I miss 
the "go-between" of the project specialist. 

#3 No comment. 

#4 There were problems in prescheduling which were resolvable 
through coordination of careful placement of the students by 
the LEP coordinator. Another problem was becoming aware of 
"babying" LEP students and knowing when to Dack off. Also> 
there were not enough tutors first semester and none second 
semes tc^r. 

8. How successful do you believe each of the Title VII components were 
this year? 

Co^letely Mostly Socsewhat Not At All 



#1 Students just love the tutors. Tm aware of the parent 
workshops but don't knov: about participation. 

#2 (A) No comment. 

(B) The first semester the tutor component was very 
successful; second semester there were not as many 
tutors. The teachers have been very pleased. They were 
spoiled first semester. ThJ tutors have been generous 
with their time. 

#3 We need whole-day staff development workshops. Also, now 
teachers want more tutors, so we* re supplementing with other 
commuiiity groups, i.e., Amistad, Hispanic lawyers. Community 
in Schools. 



Staff Developoaent 
Tutors 

Curriculma Development 
Parent Workshops 



1/ 
1/ 
li 
1/ 




3 //p. 

3 

3 



4 //Jj I <U^^'^ k 
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The actual tutors were excellent. We wanted more bodies; not 
all LEP students had one. The staff development was highly 
successful with those who We participated, but the 
participation level was extremely low. Why isn't it mandated 
that teachers have to take a certain number of hours in this 
area like they do in special education? In regard to parent 
workshops, tnere has been no feedback from parents, but they 
definitely need to be included- Sometimes there are 
transportation problems. 

9. Uhat recoraiendations do you have for modifications or issproveosent of 
the Title VII prograia in tenas of: 

Staff Development? 

#1 Mandate staff development for all content teachers to get more 
people involved, sensitive to LEP student concerns. The whole 
school needs inservice. The staff needs to realize these 
issues. Attendance should not be by choice. 

#2 (A) We don't have staff to deal with students from Middle 
Eastern countries. 

(B) Involve Dr. Pam McCurdy who is teaching the linguistics 
class at St. Edward's University now. She has taught on 
the border of El Paso and has lOts of experience working 
with ESL students. Also Steve Jackson. We need 
workshops on phonology, grammar for the ESL learner, and 
teaching strategies. 

#3 Expand it on a larger scale, the objective being to build 
awareness. Attendance should be compulsory. 

School #4 No comment. 

Tutors? 

#1 It »-^.nc very well. 

#2 (A) They need training from the University of Texas c 

(B) More tutors! It takes coordination in the beginning. 
iti We need additional information about how to use them. 
#4 More! 
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Curriculum Development? 

#1 I would like to see regular content area materials for LEP 
students displayed in nonvolunteer workshops. 

#2 (A) We really need to work on curriculum development for 
other language groups. 

(B) I haven't seen much. 

#3 We need help on how to modify or adjust lesson plans and 

teaching strategies to address LEP students. Teachers aren't 
aware that it's okay to modify curriculum. Then the pressure 
would be off them. 

#4 Come up with specific, practical, and time efficient content 
area activities. These should use already prepared materials. 



Parent Workshops? 

#1 Circulate them. Hold them in the south area neighborhoods, 
closer to home. . 

#2 (A) How to get parents of LEP students involved? Would it be 
better to have teachers free to make home visitations? 

(B) Parents need to be informed about how to work with 
teachers and students. They need information about tne 
requirements for passing from grade to grade and for 
graduation. 

#3 Most parents at the meetings" represent elementary students, 
although there have been parents of some high school students. 

#4 The person who is conducting them is excellent. 

10. What differences do you see in the 1986»87 Title VII Prograoi as 
cofspared to the igSS'-SG program? 

#1 This year it is better. The teachers have more experiences, 
and there is i;:ore consistency. There is more involvement of 
content area teachers. 

#2 (A) I wasn't here last year. 
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(B) There is more visibility and more empnasis placed on ESL 
programs (might be related to -ESL teacher being moved 
closer to teachers* lounge). Also, other language groups 
are involved. 

#3 There has been a growth in numbers; it*s ballooned. Parents 
move into the attendance area so that their students may go to 
school. The growth of the program has encouraged "old" 
students to serve as assistants, aids. This makes for an 
easier, smoother transition. They act as role models, too. 

#4 The LEP students don*\: feel like "dummies." They feel 

comfortable in their classes and around other ethnic groups. 
There is more continuity built on last yearns success. 
Teachers are a lot more familiar with abilities and needs of 
LEP students. They are able to do more in-de,:ih concept 
building. 

How have tiiese differences Impacted the program? 

#1 No comment. 

#2 (A) No comment. 

(B) There has been a greater contact with teachers. 

#3 There has been a lot more parent involvement. 

#4 No comment. 
11. Overall, do you feel Title VII has had an impact? 

#1 It has had an impact. 

#2 (A) Yes, because I've seen it done. Students identify with 
the LEP teacher. This helps them learn how to work the 
system. She is a confidant, a counselor. 

(B) Yes. There still is a tremendous need for information. 
Something happens in the home. Parents are interested in 
immigration but need to know abou^ boundary changes, 
credits, and what happens as students are phased out of 
ESL support. Title VII is helping to make a difference 
in moving these students. 
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It's exceeded its expectations at our school with students 
passing TEAMS and participating in Ballet Folklorico. It has 
helped students stay in school and their self-concept. 
There's still room for improvement. You have to have good 
teachers. 

0^, definitely. But, it still needs to be stronger. Expose 
more teachers to it. 
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Program Adminis, *v oiV.erview Questicns 
How many teachers are invo'^v^Jd In Ifitle VII through: 
tutors? 

1-50{#)J^_^ I don't know 

endorsesient classes? 

l-50(#) * I don't know 

workshops? 

l-50(#) over 200 I don't know^^ 

at parent workshop on inymgration alone 

curriculisn developmffnt? 
1-50(1) 5 I don't know 

* "You would be a better source this information than I." 

How well have endorseinent teachers issplemented Title VII program 
objectives with LEP students in t;erras of successes or problems in 
the following: 

Adapting the content areas to roecit the needs and levels of the LEP 
students? 

Information could best be gotten from interviews with the teachers 
thsrselves* However, success is definitely very apparent at Travis 
High School where the largest number of people are involved (in the 
cooperative learning workshops, endorsement series classes, and/or 
on the writing team for curriculum developinent). 

Developing appropriate and varied strategies for evaluation of LEP 
students? 

A natural approach to teaching LEP students was emphasized in 
Endorsement training. Part of evaluation is participation in these 
kinds of activities* (LEP students used to sit quietly in back of 
the rooin.) Also, teachers are using a wider variety of techniques 
to involve students; thereby, the teachers are better able to do 
more informal, on-going assessments* 
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Decreasing the dropout rate of LEP students? 

The program is -showing that LEP students are staying in school, and 
endorsement teachers, with more effective t(;Chnique3, arc largely 
responsible. However, LEP students have also been impacted by 
counseling done by Dr. Terr with their families (counsel ing-type 
parent sessions). At Travis the LEP teacher specialist is 
coordinating work/study programs that are helping keep LEP students 
in school . 

ciessonstrating increased cocspetency in instruction of LEP students? 

As previously stated, endorsement teachers are using a natural 
ipproach in teaching LEP students. Th^ ' are using an extensive 
variety of materials which havr been ..y carefully selected for all 
areas of curriculum so taat the reading level is appropriate and the 
number of concepts introduced are few/ Ntw vocabulary is also 
highlighted and/or introduced separately. 

3. Do you feel Title VII has impacted LEP student attendance? 

Yes No 

Coments: 

For accurate informa'ion, you need to check this with the computer. 

4« In your opinion, has Title VII positively Impacted the self-concept 
and school attitude of LEP students? 

Yes, A Lot To Soeue Extent Not At All 

12 3 



Cossaients: 

The Ballet Folklorico at Travis and Murchison has helped increased 
self-concepts. Also, Murchison's soccer team is mostly composed of 
LEP students. (They placed nuniber one in the city.) Students are 
achieving and staying in school. 

5« In your opiniono what lapact has Title VII had upon the acquisition 
of English language skills and acadeiaic content achieve^nt of LL 
students? 

AISD was one of six school districts in Texas that were recommended 
for an Academic Award. Title VII surely contributed to this. Also, 
you have this information, based on pre«and posttesting of 
evaluation instruments. 
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Uhat coordination are you aware of that has occurred ^ng ESL and 
content area teachers? 

Has it ieiproved? Yes No 

Is it adequate? Ye s t/ No (But, there's room for increased 

involvement.) 

Coolants: 

LcP students are being scheduled into classes of content teachars 
with ESL or workshop training. Content area teachers are being 
involved in cooperative learning workshops and curriculum handbook 
activities. 

Did any probaea(s} occur which could Impact Title VII program 
outcoeses or any campus (teacher ratings, achievement of students)? 

Murchison is still lacking a math bilingual teacher. TBE teachen^ 
at Murchison— from what I hear—were teaching nonTBE classes which 
resulted in larger numb^/s of TBE student? per teacher. Surely, 
this makfcs a difference in achievement gains. 



How successful do you believe each of the Title VII cocnponents were 
this year? 

Completely Mostly Somewhat Not At All 

12 3 4 

Staff Deve'-^opment 1^34 

Tutors 1 cD 3 4 

Cuniculisi Development 1 3' 4 

Parent Workshops ? &) ^ ^ 



CoGSQeiits: 

The cooperative learning workshops were very successful. However, 
only 15 people participated throughout. I wish we had had more 
tsachers participating. 

The tutors worked out even better this year than last. 

The curriculum development is taking shape and will be a most 
valuable tool. 

Excellent! (parent workshops) But, I wish we had had more parents 
participating throughout, including in the productive, small group 
sessions. 
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9. What recossnendations do you have for modifications or improvezient of 
the Title VII program in tarras of: 

Staff OevelGpszent? 

Continue the cooperative learning workshops. Tm very ple^ased with 
them* Tm seriorsly cor'^idering deleting the endorsement component. 

Tutors? 

Maintain as is. Add more tutors, if possible. 
CurriculiBs Development? 

We will not know until after the final draft, and teachers give us 
some feedback. 

Parertt Workshops? 

Continue with very little modification. 

10. What differences do yoy see in the 1986-87 Title VII Program as 
cra3pared to the 1985-86 program? 

This year's program has run much more smoothly. 

How have these impacted the program? 

Positive results demonstrate that the program is very well organized 
and that the leadership is most appropriate. 

11. Overall, do you feel Title ¥11 has had an impact? 

Very definitely! We have become a model program for the state. If 
a second proposal gets funded, our Title VII Program will be in a 
position to assist other school districts in the country. 



APPENDIX E 
19 



86.42 



Title VI i Program 
Appendix F 
TEACHER SU«?VEY 



177 

APl-tNDIX F 

id . 1 



86.42 



TEACHER SURVEY 



Purpose 

Questions were included in the districtwide survey for program and a 
random sample of teichers at the four Title VII schools. Responses 
provided information concerning the following questions: 

Decision Question PI: Should the Title VII Program be continued as 
it is, modified, or discontinued? 

Objective #6 - Activities: Major components will be implemented as 
planned in 1986-87. 

Evaluation Question What concerns/strengths about the 

program were identified by the program teachers? 



Procedure 

Surveys 

AISD teachers were surveyed in the spring with questions on a wide 
variety of topics. Title VII Teacher Survey questions were generatad by 
the Office of Research and Evaluation (ORE) staff with input from the 
program director. These questions were designed to elicit information 
about the implementation and effectivenesss of the endorsement end tutor 
components from endorsement participants, teachers who had tutors, and a 
random sample of teat-hers at the program scnools. The Teacher Survey 
questions were then passed on to the ORE evaluator who sent out the 
annual surveys to all teachers and administrators in Austin Independent 
School District (AISD). Teachers polled by Title VII questions responded 
Detween March 13 and April 20, 1987. (Please refer to Publication Number 
86.45, Wnere We Stand ; AISD Districtwide Surveys, 1986-8 7 and Publication 
Number 86.60, Distnctw'ide Surveys, Technical Report 19^6-87 for more 
details.) 

Sample 

Items given to the three groups varied. 

GROUP ITEMS NUMBERS 

Teachers with Tutors 10-17 
Endorsement Teachers 146-153 
Randomly Sampled Teachers 154-155 

Items cited above may be r^eferred to in Attacnment F-1. 
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Tne item response rate for those surveyed by Title VII was lower than the 
repofted AISD response rate for the adminiibtration dates noted above. 
Whereas the overall response rate was 71%, (see above publications), item 
responses of teachers with tutors ranged between 63% and 66%; out of 38 
asked, 24 or 25 responded. Item responses were received from 50% or 7 of 
the 14 endorsement teachers while of the 119 randomly sampled group, 67% 
{N=79) or 68% {N=81) teachers responded. Thus, sample sizes usually 
represented one-half to two-thirds of those surveyed. 

It should be noted that Item 154 and 155, regarding sufficient English 
and/or Spanish materials for LEP students were only sent out to a random 
sampling of teachers at the program schools. They should also have been 
given to endorsement and teachers with tutors (N=52) as well. 

Of this year's endorsement teachers, 11 of the 14 also attended ESL 
courses last year; one-half attended two classes in 1985-86. Of the 38 
teachers v/ith tutors in 1986-87, 4 also had tutors in 1985-86. Random 
sampling of teachers may hav» included some endorsement and/or teacners 
with tutors by chance. 



Results 

ODjective #6 - Activities*, Major components will oe implemented as 
planned in 1986-87. 

Evaluation Question Dl-14. What concerns/strengths about the 
program were identified by the program teachers? 

In terms of this year's tutor findings, teacher responses concerning 
tutors* characteristics and impact were largely divided between the 
strongly agree/agree and neutral categories. Items 10-14 dealt with 
whether tutors were perceived as helpful, knowledgeable, well -prepared, 
reliable, and positive. Most respondents eicher agreed tutors had these 
attributes (36-56%) or were neutral (28-44%). The two statements with 
the hignest percentage of respondents disagreeing (20%) related to 
whether tutors wera well -prepared and reliable. 

Items 15, 16, and 17 dealt with tne impact oT tutors or students. 
Respondents were most positive about tne tutors' impact on students* 
attitude toward learning (54% agreed), followed by their impact on 
academic skills (38% agreed), and finally their impact on tu ^.es* Enylish 
skills (29* agreed). In terms of improved LEP student academic skills, 
^7% (N=24) of those surveyed responded that tutors had an impact; 29% 
{N=24) or the teachers reported that LEP student's English improved as a 
result of working with tutors. 

Endorsement data from the 50% wno responded may oe found in Attachment 
F-1, items 146-153. Items 146-150 dealt with the quality of the 
endorsement training. Most responses were positive or neutral. The 
highest percentage agreed (43%) trainers were knowledgeable and 
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well-prepared; the lowest percentage {U%) agreed the training presented 
new skills or could be applied in the classroom. 

On Items 151-153, 43% agreed the training impacted students' English 
skills, acadanic skills, and attitude toward learning. 

Endorsement responses from Items 146-150 on the spring, 1987 survey were 
examined in terms of responses for similar items on the spring, 1986 
survey. As can be seen in Figure 1, half (1987) or fewer (1986) teachers 
responded e='ch year. Most who did indicated neutral opinions both 
years. However, in 1986, those who weren't nc- itral generally expressed 
positi.ve opinions. In 1987, the pattern of tliose who were not neutral 
was somewhat different; fewer agreed and some disagreed with questions 
concerning the value of the endorsement trainer and training. 

Of the random sample of teachers at the program scnools who responded, 
almost or more than three-fourths (74%, N=81 and SZ%» N=79) agreed that 
instructional materials in English and/or Spanish were adequate (Items 
154-155). 



FIGURE 1 

USEFULNESS OF ENOORS£HE;rr TRAINING—RESPONSES TO U!STKICTWIDE 
SURVEY ITEMS BY TEACHERS IN TRAINING IN SPRIKG. 1986 AND SPRING, 1987 
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lO.lHE TITLE vn TUTORS hERE HEL!>FUL TO THE STUDENT. 

A. STRUNGLY AGREE . f.. KEUlKAL E. STRONGLY DISAGREE 
6. ACREC C. CISAGREE 

Nl'KBER OF 



RESPONSE SUMMARY FOR SPRING 1987 TEACHER SURVEY • Tf7LE VU 



00 
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RESPONSES 
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0 
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40. OS 
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0 
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SECONDARY 


25 


6 
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8 
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10 
40. OS 
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11. THE TITLE VU TUTORS HERE KNOhLEOGEABLE. 

A. STRONGLY AGREE C. NEUTRAL E. STRONGLY DISAGREE 
6. ACRES 0. DISAGREE 



TCTAtS 



NUMBER OF 
RESPONSES 

25 



5 6 Al 3 0 

20.0S 24. OS 44. OS 12.0? 0«0S 



SECONDARY • 25 
JA« HIGH SCHOOL. 6 
HIGH SCHOOL 19 



5 6 11 3 0 

20.0S 24.0S 44. OS 12(0S O.OS 

I I 3-10 

16. 7S t6.7S 50. OS 16. 7S O.OS 

4 5 6 2 0 

21. IS 26.3S 42. IS 10. 5t O.OS 
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RESPONSE SUMMARY FOR SPRING 1987 TCACHER SURVEY - TITLE VII 



> 

m 



12.THE TITLE VII TUTORS WL E WELL PREPAREO. 

A, STRONGLY ACaEE C, NEUTRAL E, STRONGLY OISAGREE 
a* AGREc 0. DISAGREE 



TOTALS 



NUMBER OF 
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13. THE IITLE VU TUTORS WERE RELIABLfc. 

A. STRONGLY AGREE C. NEUTRAL E. STRONGLY OISAGREE 
a. AGREE 0. DISAGREE 



TOTALS 
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RESPONSE SUMMARY FOR SPRING 1987 TEACHER SURVEY - TITLE VII 



U.THE TITLE VIl TUTORS WEKE POSITIVE IN THEIR 

aI^STRONCLY AGREE C* NEUTRAL E. STRONGLY OtSAGREE 
B. AGREE 0. DISAGREE 



lOTALS 



NUMefR OF 
RESPONSES 

25 
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2 L L 2 0 

33. 3X L6«7t L6«7S 33«3S 0«0; 

A 7 6 2 0 

2Ur< 36«8X 3U6S L0.5S O.Ot 



00 
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15. AS A RESULT OF kORKiNG WITH THE HTLE VU TUTORS, 
MY STUOENTS IMPRCVEO IN ENGLISH SKILLS. 

A. STRONGLY AGREE C. NEUTRAL E. STiiONGLY OlSAGREE- 

B. AGREE 0. DISAGREE 



TOTALS 



NUMBER OF 
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5.3X 26. 3t 47<»4X 21. IX O.OX 
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RESPONSE SUMMARY FOR SPRING 1987 TEACHER SURVEY - TITLE Vll 
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16. AS A RESULT OF WORKING WITH IHE TITLE VII TUTORS. 
HY STUDENTS IMPRCVEO IN ACAOEMIC SKILLS. 
A. STRONGLY AGREE C. hEUTRAL E. STRONGLY OlSAGREE 
a. AGREE 0. OlSAHREE 

NUMBER OF 

RESPONSES A B C 0 



TOTALS 



1 8 12 3 0 

33*3% 50*0% 12.5S O.OS 



3? 



5~o 



/3 



SECGNCARY 2^ 
JR. HIGH SCHOOL 5 
HIGH SCHOOL 19 



1 8 12 3 0 

^•2« 33.3^ 50.0X 12. 5< 0.02 

0 13 10 
O.OX 20.02 60.02 20.02 0.02 

1 7 9 2 0 
5.32 36.82 ^T.^Z 10.52 0.02 



17. AS A RESULT OF kCRKUG WITH THE TUTORSt HY STUDENTS 
HAO A MORE POSITIVE ATTITUDE TOWARD LEARNING, 



A* STRUNGLV AGREL 
B. AGREE 



TCTALS 
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0. OlSAGRE' 
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SECONDARY 24 • 

JR* HIGH SCHOOL 5 
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RCSPONSE SUHHARY FOR SPRING 1987 TEACHER SURVEY - TITLE VII 



l46.RECAR0lhG ENOQRSEHEHT TRAIN INCt THE TRAINLRS UERL 
KNOWLEOGEABLE AND WELL PREPAREO. 

A. ALMOST ALWAYS 0. RARELY - 

B. FREQUENTLY E. ALMOST NEVER 
C* SOHEIIHES 

HUHBER OF 

RESPONSES A B C 0 c 

0.0« ^2.9t O.OX 14*3X 



»«^» ^^"^^^ ' O.Sx ^2.9* 42 Jx O.Sx U.U 

^ 147.REGAR0XNG ENOORSEMENI TRAINING, THE TRAINING ViAS 

^ INTERESTING ANO IKFCBPATIVE. 
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^ C« SOMETIMES 
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RESPONSE SUHHAKY fOR SPMiNC 1907 TEACHER SURVEY - TITLE VII 
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00 
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U8. REGARDING ENDORSEMENT TRAIN INGt IHE CONNECTION 

8ETMEEN THEORY A^^D APPLICATION WAS CLEARLY STATED. 
A. ALMOST ALMAYS 0. RARELY 

8. FREQUENTLY E. ALNCST NEVER 

C. SOHETIHES 
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149.REGAR01NC ENDORSEMENT TRAIN INGt THE TRANING PRE- 
SENTED NEhi SKILLS. 

A. ALMOST ALkAVS D. RARELY 

8. FREQUENTLY ALMOST NEVER 

C. SOMETIMES 



NUMBER OF 
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RESPONSE SUMMAt^Y FOK SPRING 1987 TEACHER SURVEY - T15LE VU 



150.REGAR01NG ENOURSEHENI TRAINING* I COULO APPLY )HE 
INFOAHATION PROVlUEO SN THE CLASSROOM. 

A, ALMOST ALWAYS 0. RARi^LY 

B. FREQUENTLY E. ALMOST NEVER 
C« SOMETIMES 

NUMBER OF 

RESPONSES ABC 



TOTALS 



C 1 5 0 I 

O.OX 14,3% 7U4S O.OZ 14.3S 



/V 7/ // 



HIGH SCHOOL 
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151«AS A RESULT UF MY PARTICIPATION IN THE ENOORS^- 
MENT CLASSES. MY STUOENTS IMPROVES IN ENGLISH 
SKlLlSc 

A. STRCNGLY AGREE 0. CISAGREE 

B. AGREE E. STRONGLY OlSAGREE 
C« NEUTRAL F. OON«T KNOW 



TOTALS 



NUMBER OF 
RESPONSES 



0 3 2 

O.Ot 42.9t 28.6X 



0 2 
O.Ot 28.6t 
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O.Ot 
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152.AS A RESULT OF MY PARTICIPATION IN THE ENDORSE* 
f<ENT CLASSES* HY STUCENTS IMPROVED IN ACADEMIC 
SKILLS. 

A. STRONGLY AGREE D. DISAGREE 

8. AGREfc E. STRONGLY DISAGREE 

C. NEUTRAL f. UCNM KNOU 

NUMBER OF 

RESPONSES ABC 



TCTALS 
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D 1 1 
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153. AS A RESULT OF MY PARTICIPATION IN THE ENDORSE- 
MENT CLASSES* HY STUCENTS HAC A MORE POSITIVE 
ATTITUDE TOkARD LEARNING. 

A. STRONGLY AGREE D. DISAGREE 

B. AGREE E. STRCKGLY DISAGREE 

C. NEUTRAL F. DCN« T KNOh 
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154. 1 HAVE SUFFICIENT INSTRUCTIDNAL KATERIALS IN ENGLISH 
TO ACORESS THE RANGE OF AEADABILITV LEVELS IN MY LEP 
STUDENTS. 

A. Y£S 

8. NO 

C. I HAVE NO LEP STUDENTS. 
CCKHENTSX 



00 



NUK8ER OF 
RESPONSES 



TOTALS 



81 



27 33 21 
33.32 40. 7S 25. 9S 



SECONDARY 81 27 33 21 

33. 3S 40.7S 25. 9S 

JR. HIGH SCHOOL 8 « 3 3 2 

37. 5S 37. 5S 25. OS 

HIGH SCHOOL 73 24 30 19 

32.9S 41.13 26.0S 

^ 155.1 HAVE SUFFICIENT INSTRUCTIONAL PATFRlALS IH SPANISH 

m TO ADDRESS THE RANGE OF READABILITY LEVELS IN MY LEP 

JlJg SIUDENTS. 

^ A. YES 

X a. NO 

^ C« I HAVE NO LEP STUDENTS. 

CCHHENTSs 

HUN8ER OF 

RESPONSES ABC 

TOTALS 79 7 52 20 

8,9S 65.&S 25.3S 
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TUTOR RECORDS 
Purpose 

University of Texas students who assisted LEP students on an individual basis 
in the content areas maintained tutor records which provided information 
concerning; 

Decision Question Dl: Should AISD adopt the Title VII Program Components 
when federal funding expi res? 

Objective #1 - English proficiency: By the end of eacn project year, project 
students* average posttest percentile scores on the English Language Assessment 
Battery (LAB) will De higher than the pretest percentile scores, (all four 
schools 

Evaluation Question Dl'"3, Did participants who were tutored 
exmixlt greater percentile gains, on the average, in English 
proficiency compared to those not tutored? 

Evaluation Question 01-4, Did the percentage of tutored program^ 
participants making gains exceed that found last year? (all four 
schools) 

Objective #2 English Achievessent: By the end of each project year, program 
students' average posttest percentile scores on the Iowa Tests of Beisic Skills 
(ITBS) and the Tests of Achievement and Proficiency (TAP) (as appropriate) 
will be higher than average pretest percentile scores by subject area, (all 
schools) 

Evaluation Question Did participants who were tutored 

exhibit greater percentile gains, on the average, in English 
achievement compared to those not tutored? 

Evaluation Question Did the percentage of tutored program 

participants making gains exceed that found last year? (all four 
schools) 

Objective #6 « Activities: Major components will be implemented as planned in 
1986-87. 

Evaluation Question 01-18. Whc was served by each component? How 
often? What was the cost per student? In which content areas did 
program participants receive tutoring services? 
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Procedure 

Students Served 

For the second year. University of Texas tutors from multicultural classes 
assisted program LEP students ♦ Plans for 1986-87 were to assign tutors to all 
four campuses both semesters ♦ Tutors were assigned to all four program 
schools first semester. Second semester, Anderson did not have any tutors 
because of problems in assignment coordination and tutor transportation. 

How Tutoring Was Carried Out 

English speaking tutors were able to work with Hispanic LEP students by 
adapting and simplifying materials, e.g., with illustrations, note-taking, 
clarification of vocabulary, utilization of Spanish/English dictionaries, and 
identification of main concepts. 

Data Collection 

Two sessions of University of Texas students, enrolled in multicultural 
education courses, kept record forms in duplicates whicn provided data about 
the students served. The record forms (see Attachment G-1) were jointly 
maintained by the student who entered data and the tutee's teacher who kept 
the record form file in the classroom. At the end of the semester, one copy 
of the record form was to have been given to a coordinating teacher at each 
program campus wnile the tutee's teacher kept the second copy. Two data 
collection problems impacted counts of students served and comparisons of 
tutored and nontutored students' performance. Both problems may have resulted 
in some tutored students being assigned to the nontutored group. 

8 First semester, no tutor records were received from one school and 
both semesters' data was incomplete from all schools. Also, some 
tutor records lacked the last names of the tutored students. 
Attempts were made to trace last names, through telephone calls to 
teachers and computerized printouts of class lists. However, 
frequently the printouts were not helpful, because there were several 
students in the a class with the same first name, making it 
impossible to identify the tutored student. 

9 This year other community groups have been tutoring at tne four 
program schools. This was not determined until spring interviews. 
Names of those tutored by others were not available. Some program 
LEP students who were designated as nontutored may have actually been 
tutored. 

See the Discussion section for possible improvements in data collection next 
year. 

Data Analysis 

This will be discussed in the Results section. 
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Results 

Objective #1 - Englisn proficiency: By the end of each program year, program 
students' average posttest percentile scores on the English Languaoe Assessment 
Battery (LAB) will be higher than the pretest percentile scores, (all schools) 

Evaluation Question Dl-3> Did participants who were tutored exhibit 
greater percentile gains, on the average, in English proficiency 
compared to those not tutored? 

Evaluation Question Did the percentage of tutored program 

participants making gains exceed that found last year? (all four 
schools) 

Objective #2 English Achievsnent: By the end of each program year, program 
students' average posttest percentile scores on the Iowa Tests of Basic Skills 
(ITBS) and the Tests of Achievement and Proficiency (TAP) (as appropriate) 
will be higher than average pretest percentile scores by subject area, (all 
schools) 

Evaluation Question Dl"6> Did participants who were tutored exhibit 
greater percentile gains, on the average, in English achievement 
compared to those not tutored? 

Evaluation Question Dl-7. Did the percentage of tutored program 
participants making gains exceed that found last year? (all four 
schools) 

Complete evaluation findings examining the gains of tutored and nontutored 
program students may be found in Appendix A, LAB, and Appendix C, ITBS/TAP, of 
this technical report. The following is a suirenary of the relevant findings: 

6 English proficiency (LAB) 

— significant differences in favor of tutored students were not found 

on the LAB. " ♦ 
~ The percentage of tutored students making gains in 1986-87 (86.4%) 
was considerably higher than that found in 1985-86 (47.2%). 
• English achievement (ITBS) 

~ ITBS/TAP percentile scores increased more for tutored students tnan 
nontutored in two-thirds of the comparisons (6 of 9); they were not 
tested for significance because of small sample sizes. 
0 — In 1987, a greater percentage of tutored students made gains in 
reading, mathematics, and science than in the previous year. 
However, the 1987 sample size was generally much smaller. 
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Objective #6 - Activities: Major components will be implemented as planned in 
1986-87. 

Evaluation Question DH8. Who was served by each component? How often? 
What was the cost per student? In which content areas did program 
participants receive tutoring services? 

Hand tallying done by the evaluation associate determined that during the 
first semester, 1986-87, 39 tutors were assigned to program LEP students at 
the four program campuses; 30 tutors were assigned second semester to program 
participants at three schools. SAS program, SA -BY006-0101, written by the 
programmer analyst, revealed that in 1986-87, 120 program LEP students 
received tutoring services. This was considerably more than tne 78 program 
students in 1985-86 who were served. (See Attachment G-2.) Host LEP students 
were tutored twice weekly per subject; some received more assistance, usually 
from more than one tutor. There were no additional expenditures for tutoring 
during 1986-87. The overall cost per Title VII student was $321 (see Appendix 
I, District Records); this was based on costs of personnel, testing, supplies, 
etc.. 



Program LEP students were tutored by 60 tutors in seventeen content areas 
according to hgnd tallying done by the evaluation associate. 



e Mathematics 

9 English 

0 Vocational Arts 

d Biology 

d ESL 

6 Social Studies 



0 Reading 
e Homemaking 
© Typing 



9 Geography 
e World Geography 
Pre Algebra 



9 



9 American History 

e History 

9 Science 

9 Physical Science 

9 Drama 



Discussion 

Proposed improvements for data collection of tutor records include providing 
tutors with computerized monthly printouts of students' names with entry 
spaces for evaluation data needed for those tutored (perhaps by class). The 
evaluation associate could give instructions to tutors aoout entering data in 
bound printouts to be maintained by the receiving teacher. 

National research (Conen, 1982) suggests peer tutoring programs are most 
effective when: 

9 Highly structured with well-planned curricula and methods, 

9 Focused on basic content and skills, and 

9 Relatively short in duration (a few weeks or months). 

Title Vil and UT staff should explore whether more extensive training of 
tutors could strengthen the program still further. More training of students 
in the use of ESL techniques might be particularly helpful, because most speak 
only English. Also, logs indicate tutors often worked with the whole 
class— this does not really constitute "tutoring". 
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Record of Tutor Services (Title VII Project) 
Part I: Time Sheet 

Tutor School 



Pull Name of LEP 
Students ( s ) Tutored 



Grade Content Area 



Contact Minutes Date 
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PARENT WORKSHOPS 



Purpose 

Decision Question UK Should AISD adopt the Title VII Program 

Components when federal funding expires? 

Objective #6 - Activities: Major components will be implemented as 
planned in 1986-87. - 

Evaluation Question Dl-13 > What training was offered to parents? 
How many participated? Did parents of LEP students participating 
in parent training gain understanding of their children's 
situational problems and techniques to assist their children in 
handling them? 



Results 

This new 1986-87 component was implemented as planned. A series of six 
workshops, repeated three times, dealt with the following topics. 

Helping your children learn 
Extracurricular activities 
Preventing runaways 

Helping your children say "no" to drugs and alcohol 
Sexual problems of adolescence 

Ethnic differences in the role and authority of police in assisting 
students 

Importance of communication 
Adjustment to a new culture and country 
Hispanic conflicts and acceptance 
New immigration law 

Parent workshops were given by a Spanish/English speaking clinical 
psychologist, with a background in education and counseling. Evaluation 
forms (see Attachment H-1) completed at each meeting indicated that 
parent attendance varied between 3 and 100* Attendance was reportedly 
even higher at some sessions based on staff reports (all may not have 
turned in evaluation forms). Overall, the evaluations were uniformly 
positive. Very few responded with neutral or negative responses. 

Parents wanted more discussion about the following topics: 

e Approaching sex education with their children 

• New immigration law 

0 Drugs in adolescence 

a Helping children take advantage of school 

t Signs and causes of homosexuality 
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In addition to the findings of the 1986-87 implemented parent workshops, 
data gathered concerning on-going teacher workshops revealed that they 
were implemented as planned and focused on two topics: 

• Designing lesson plans for LEP students, and 
t Mainstreaming LEP students in secondary content area classes 
using cooperative learning techniques. 

The lesson plan workshop was held in December, 1986, and was attended by 
nine teachers. In-service evaluation questionnaires were filled out by 
participants. Teachers indicated overall satisfaction with the workshop 
program and presenter* (See Attachment H-3.) 

Of the nine respondents, eight said they would like more related 
training. All respondents gave high effectiveness ratings to aspects of 
both the presentation and presenter. (See Attachment H-3.) 

The second group of workshops, which focused on using cooperative 
learning for mainstreamed LEP students, was held during the spring of 
ly87. The series of five workshops, repeated twice, was attended oy 18 
program teachers. Teachers were asked to complete a pre- and post 
workshop survey. (See Attachment H-2.) Participants surveyed at the 
beginning of the series had a wide range of familiarity with cooperative 
learning concepts and techniques. The seven teachers responding to the 
survey at the end of the course provided generally positive responses. 

All were implementing cooperative learning techniques. 

All felt adequately prepared to use the techniques. 

The pre- and post-survey responses for these seven teachers were reviewed 
for each of the 10 items. The number of responses which became more 
positive varied from 4 to 7 per item. All teachers felt more comfortaole 
defining the term "cooperative learning"; 6 of 7 believed they were able 
to organize cooperative learning better. The two items for which only 
four of the seven teachers showed improved ratings at the end related to 
their familiarity with research on cooperative learning and their comfort 
in using the techniques. The three who were somewhat familiar with the 
literature and almost always felt comfortable with the techniques 
initially were the ones whose ratings did not change after the workshop 
series. Thus, overall responses were positive/ 
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Program Educacion !}i1inviie Fecha 

EVALUACION DE LA SESION 

NO ES NECESARIO FIRMAR SU NOMBRE 

Para planear sesiones en el futuro dTganos como 1e gust6 esta sesion. 

Marque un cTrculo alredor de la carita que mas bien ensene su reaccion 
a cada pregunta. 



1. La plStica mantuvo mi atencion. 




4. Soy dispuesto de animar a otros padres que vengan a estas sesiones^ 




5. Las plSticas me hicieron sentir optimista para el futuro. 




Puede escribir sus comentarios acerca de esta plStica. 




iQue otras tanas le gustarfa que se trataran en el futuro? 
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Name 

School 

Cooperative Learning Workshop Survey 
(Pretest) 

Please respond to- the first two questions using this scale: 

Very Much Somewhat A Little l^ot At All 

12 3 4 

1. I feel comfortable defining the term "cooperative (D ® Q 0 
learning". 12 3 4 

2. I am familiar with research concerning the effectiveness (D (£i<D(r\ 
of cooperative learning upon student achievement. 12 3 4 

Use this scale to answer the following questions. 

Almost Always Frequently Sometimes Rarely Almost Never 
1 2 3 4 5 

3. I feel comfortable using cooperative learning (s) CD(D(D 
techniques. * 12 3 4 5 

4. I am able to organize students into effective (D 
cooperative learning groups. 12 3 4 5 

5. I am able to select appropriate tasks for cooperative ^ (23 
learning groups. 12 3 4 5 

6. I am able to select appropriate materials for' (^(^ 
cooperative learning groups. 12 3 4 5 

Use this scale to respond to these questions. 

Many (8 or more) Some (4-7) Few (1-3) None 

1 2 3 4 

.7. How many books and/or articles about cooperative 

learning have you read? 12 3 4 

8. How many times have you used cooperative learning 

techniques? 12 3 4 
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Use this scale to answer the following questions. 

Strongly agree Agree Disagree Strongly disagree 

12 3 4 

9. I feel confident instructing a colleague in the 

Structuring of cooperative learning groups. i 2 3 4 >^ (Ln-y^^^z 

Co 

10. I am able to use cooperative learning to affect <S) (2) 

student achievement. 1 2 3 4 7u C^.^^^^ 

a> ' 

11. List three cooperative learning techniques. 
Teacher #1— -Grouping according to ability 

Grouping with student instructor 

Practice what was modeled by teacher 
Teacher #2— Small group work with students of mixed abilities 

Small group works to solve a conmon problem 
Teacher #3— None given 
Teacher #4~Pairing 

Small groups 

Guided practice 
Teacher #5— None given 

Teacher #6~Individual group work at different levels 

Content area groups broken off according to students' 
grade levels 

Teacher #7— None given 

12. List three strengths of cooperative learninq. 

Teacher #1— Several levels can be taught at the same time 

Several skills can be taught at the same time 

Students are on task since they are working at their 
level of understanding 
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Teacher #2"Low level students may succeed 

Low level of anxiety over competition 

Students support each other 
Teacher #3— None given 
Teacher #4"Support from the group 

Immediate feedback 

Building self-esteem 

Teacher #5— Involve more people in common goal 

Use the strengths of group to offset individual 
weakness 

Motivate more people to learn 

Teacher #6"Students feel more at ease In small groups 

Students respond to one another more freely 

Students put pressure on one another to get work done 
within each other's groups 

Teacner #7— None given 
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Name 

School 

Cooperative Learning Workshop Survey 
(Posttest; 

Please respond to the first two questions using this scale: 

Very Much Somewhat A Little Not At All 

12 3 4 

1. I feel comfortable defining the term "cooperative 

learning". 12 3 4 

2. I am familiar with research concerning the effectiveness © (±j 

of cooperative learning upon student achievement. 12 3 4 

Use this scale to answer the following questions. 

Almost Always Frequently Sometimes Rarely Almost Never 
1 2 3 4 5 

3. I feel comfortable using cooperative learning ^(Tj 
techniques. 12 3 4 5 

4. I am able to organize students into effective Qj Cb 
cooperative learning groups. 12 3 4 5 

5. I am able to select appropriate tasks for cooperative 

learning groups. 12 3 4 5 

6. I am able to select appropriate materials for (S) 
cooperative learning groups. 12 3 4 5 

Use this scale to respond to these questions. 

Many (8 or more) Some (4-7) Few (1-3) None 

1 2 3 4 

7. How many books and/or articles about cooperative djQj 
learning have you read? 12 3 4 

8. How many times have you used cooperative learning ^ G) (T) 
techniques? 12 3 4 
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Use this scale to answer the following questions. 



Strongly agree Agree Disagree Strongly disagree 

12 3 4 

9. I feel confident instructing a colleague in the 

structuring of cooperative learning groups. 12 3 4 

10. I am able to use cooperative learning to affect Q)C±) 

student achievement. 1 ZZ 4 



11. List three cooperative learning techniques. 
Teacher #1— Break into small groups (3-6) 
Assign roles 

Give task with a variety of responses and then have each 
group share findings and analyze results to apply to 
each member personally 

Teacher #2— Divide class into heterogeneous groups 

Pick group leader/reporter 

Teacher facilitates by checking up on groups 
after giving instructions/examples 

Teacher #3— Group work 

Discovery learning through doing 

Responsible students help guide learning process 

Teacher #4— Students help one another 
Students learn by discovery 

Students are guided by teacher preparation and 
instructions, then supervision 

Teacher #5— Sequencing 

Spaces 

Categories 
Teacher #6--Small group teaching 

Teams-Games-Tournaments (TGT) 

Students Teams— Achievement Divisions (STAD) 
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Teacher #7— Task sturcture (mix activities) 

Reward structure (Rewards for appropriate behavior; 
interpersonal reward structure) 

Authority structure (Refers to the control 

that students exercise over their own activites) 

12. List three strengths of cooperative learning. 

Teacher #1--Student is less intimidated 

Small group gives more opportunity for participation 

Other students model expected behavior 
Teacher #2— All students participate even LEP students 

Learning environment can be non-competitive in design 

This technique makes learning "fun." It teaches high 
levels of thinking (synthesis, evaluation). 

Teacher #3— Helps reduce anxiety level of student new to language 

Helps increase motivation 

Helps students learri by discovery 
Teacher #4— Association with real world 

Verbal skills improve 

Thinking ability improves 
Teacher #5— Students teach each other 

Provides slower students an opportunity to participate 

Teachers teamwork to achieve individual and group goals 
Teacher #6— Students feel positive about completing task 

Students feel good about helping one another 

Interracial cooperation improves racial attitudes and 
behaviors in school 
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Name 



Teacher #7— Students participate actively 
Develops the question skill 

Cooperative learning encourages others to participate 
and express ideas and support 

13 • I implemented cooperative learning activities in my classroom. 

(±) Y es ^No 

If yes, use this scale to answer the following questions: 

Strongl V Agree Agree Disagree Strongly Disagree 
1 ' 2 3 4 

14. I felt adequately prepared to use cooperative learning techniques in 
the classroom. 

l(3 2(2) 3 4 

15. I assigned specific roles to each student in every group. 

1® • 2(2) 3© 4 

16. My role as a teacher was that of facilitator. 

l(D 2(E> 3(D 4 

17. The reporter from each group reported to the large group. 

lCS> i(s) 3 4 

18. I was able to incorporate content information and use of higher 
order skills through questions and probing. 



i® 2® 3 4 

19. The groups consisted of 4-6 students. 

2 ® 3 

20. I was appraised during a time when my class was participating in 
^•^ cooperative learning activites. 

21. My appraiser{s) liked what was going on in my classroorji^ 
O APPENDIX H 
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22. My appraisal was higher when I was a cooperative learning 
facilitator than when I was a traditional teacher. 





Added by Teacher #5: 

23. Although there is not a space required, I would like to add that* 
this was a very interesting workshop. I have just scratched the surface 
of the subject. I would like to see more offerings in subject areas. It 
is definitely a way to get students interested. I would like more 
information about it. 
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OFFICE OF STAFF DEVELOPMENT 
IN-SERVICE EVALUATION QUESTIONNAIRE 



Please complete each Item and return to the session monitor as you leave the session. 



SESSION IDENTIFICATION 
Session Title: 



CDCDCDC3>CDG3CDGDCD(S)<ID(ID 

Designing. Lesson Plans for LEP Students 





C3) d^flT 


GDGe)OCS)GSCE)CDCS>OCD 




(SD(S)G><S)<S>0(3Z>(S>0(SD 


1^1 H El 


(3) (5) GD ® CE) CB (S>'<S> O CS) 


MRU 







Pre8enter(8): 



Francis Rhoads 



C3) CB> G) (S>.(5> QD CS) O O GS) 






<S)(5)G?(S)CS)C5)CE)C5>e)€2D 






CS)C5><S)®<E)<£)CE)<E>G)<S) 







B. YOUR POSITION/LOCATION 

Job Title: o Teacher oAlde o Administrator o other 



GS>(S>(3><S><S><S>(S>(B>(3)<S> 




<S)C5>C3>®<S)G9(S)<E)0<5) 




C5>CH)0(5)(2>CSCE)<H)OC2) 





Office or 

School # (See Back) 



r^i^ ^ ^ ^ ^ • , ^- All-level 

OK oi o2 o3 o4 OS o6 o Secondary o Elementary o Other 

. PROGRAM/PRESENTERCS) 

Please circle the number on the scale which best describes your assessment of the 
program/presenter. 



1. Objectives were clear; 

2. Interest v.^s maintained. 

3. Information was presented clearly and concisely* 
4* Content was relevant/useful. 

5. Audio-visual materials were effectively used. 

6* Prihted materials were effectively used* 

7. Objectives were met 

8. Presenter was knowledgeable and well prepared. 



LOW 
P 

CD 

CD 

CD 
CD 
CD 



CD 
CD 
CD 
CD 
CD 
CD 
CD 



CD 
CD 

a> 

CD 

CD< 
CD 
CD 
CD 




0. FUTURE PUNNING 

Please Indicate whether or not you would like additional training on this subject. 

(9 (D 

p yes • o no om.+f^d 

E. ADDITIONAL COMMENTS 

Tufure^ requests co»"'"ents, or suggestions regarding this session and/or . 
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DISTRICT RECORDS 
Purpose 

District records provided information concerning: 

Decision Question Dl ; Should AISD adopt the Title VII Program 

Components when federal funding expires? 

Objective #6 - Activities: Major components will ne implemented as planned 
in 1986-87. 

Evaluation Question Dl-15 , How many teachers completed 1, 2, 3, 
and/or 4 classes in the endorsement series? What were the teacners* 
subject areas? Wh-at was the cost per teacher? 

Evaluation Question Dl-17 > How many LEP students were placed in the 
classes of endorsement participants? How many were not? (by school) 

Evaluation Question Dl-IB , Who was served by each component? How 
often? What was the cost per student? In which content areas did 
program participants receive tutoring services? 



Results 

The above evaluation questions have previously been discussed in Appendix D 
- Endorsement Teachers, Appendix H - Parent Workshops, and Appendix G - 
Tutor Records. Although there were no direct student costs. Title VII 
expenditures for salaries, employee benefits, supplies, travel, telephone, 
reproduction, data processing, etc. resulted in an indirect cost of $320.78 
per student; this was based on the October, 1986 Title VII Program student 
enrollment count (274 students) and the 1986-87 federal grant budget 
allocation of $87,893. ' 
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DROPOUTS 



Purpose 

The AISD dropout rates were examined in terms of Title VII LEP students 
at the four program schools. 

Decision Question Dl; Should AISD adopt the Title VII Program 

components when federal* funding expires? 

Objective #6 - Activities: Major components wi11 be implemented as 

planned in 1986-87. 

Evaluation Question Dl-19> What effect did the program have on the 
dropout rate of LEP students? 



Procedures 

District records provided the information for the data analysis. 
Procedures for how dropouts are counted may be found in Attachment J-1, 
taken from Publication No. 85.70, 1985-86 FINAL DROPOUT REPORT . These 
procedures were used by the Office of Research and Evaluation (ORE) 
evaluation associate in charge of dropout analysis in writing SAS 
programs SA - PS014 and SA - PS0141201 to calculate s^jecific Hispanic LEP 
dropout frequencies. The data were then grouped by LEP status (with 
program LEP students separated out) and summarized by the Title VII 
evaluation associate. (See Attachment J-2.) 



Results 

Figure J-2 shows the 1985-86 annua! secondary dropout rate of program LEP 
A and B students (English monolingual, or Spanish dominant) and other LEP 
CjD, and E students (bilingual, English dominant^ and English 
monolingual) attending Title VII program campuses. Rates cover the 
period of September through July of 1985-86. Students are considered 
dropouts if they leave AISD during the year and a request for a 
transcript is not received by July 1. LEP dropout rates are 
overestimates to the extent that students return to other countries that 
do not request transcripts. Also, it should be noted that some program 
LEP B status students (6 or less) changed to LEP C status before the end 
of the 1985-86 school year. These students were not counted as program 
students in the dropout analysis, and how this might have affected the 
analysis is unknown. 
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0 The LEP dropout rate for Spanish speakers at the four Title VII 
schools overall (18%) was well above the District rate (10.7%) 
and slightly above the District's Hispanic rate (15.3%). 

• The rate for program students (LEP A&B) was slightly lower (18%) 
than that for LEP C, D, & E students (20%) at the Title VII 
schools. 

• The LEP dropout rate was highest at grade 9 (37%) with little 
difference between program students and other LEP status 
students at the schools. 

• Travis had the highest LEP dropout rate. For program LEPs it 
was 34% and for other LEPs it was 29%. 

• Murchison Jr. Hi. LEP students were less likely to drop out (90% 
continuing) than Title VII senior high schools, regardless of 
their LEP status. (Junior high dropout rates were lower than 
senior high rates for AISD overall as well.) 

• At Anderson, there were no dropouts among the nine program LEP 
students enrolled (N very small). However t 25% of the 24 LEP C, 
D, E status students at Anderson left school. 
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FINAL REPORT 



The Office of Research and Evaluation (ORE) has reported yearly high school 
dropout counts since 1983-84. In July, 1986, a longitudinal computerized data 
oase (the Secondary Student Longitudinal File, or SSLF) was constructed that 
enables us to answer questions about the enrollment status of any group of 
high school students at any point in time, beginning with students enrolled 
during the 1983-84 school year. This report will present data from three 
cohorts of high school students—those enrolled in 1983-84, 1984-85, and 
1985-86. (Of course these are not independent. Many students appear in two 
or more cohorts.) 

Assigning Dropout Status Codes on the SSLF 

Our method for assigning dropout status codes on the SSLF is as follows: 

• Each year's cohort includes all students enrolled in an AISD high 
school at any time during the school year. 

a Any student who withdraws from AISD is first considered a dropout. 

• If the student's transcript is requested by a district, school, or 
other institution offering a high school diploma, the student is 
judged to be pursuing an education and his/her classification is 

"changed from "dropout" to "transfer." 

• In July following each school year, dropout status codes are assigned 
to each student in that yearns population. Possible statuses are: 

—still enrolled 

—school-year dropout (withdrew, no transcript request) 
—school-year transfer (withdrew, transcript request) 
—graduate 
—died. 

« The annual dropout rate is calculated by dividing the number of 
school-year dropouts by the total enrollment. 

• Also in July, dropout codes assigned in years before the school year 
just completed are updated to reflect changes 1n status or information 
not available the pr^vious July. Besides changes, two additional 
statuses became possible at this updating. 

—summer dropout (completed one school year, but did not show 

up the following school year, and no transcript request), 
—summer transfer (same as above but with transcript request). 

• Longitudinal dropout rates are calculated from the updated numbers. 
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FIGURE J-1 

ANNUAL 1985-86 SECONDARY DROPOUT RATE FOR TITLE VII SCHOOLS 
SPANISH DOMINANT/MONOLINGUAL (LEP A & B) VERSUS 
OTHER SPANISH LEP (C, 0, & E) STUDENTS 



Group LEP A i B STUDENTS 


LEP CD, E STUDENTS 


COMBINED LEP STUDENTS (A,B.C.D.&£) 


School Dropouts Enrollment Dropout % 


Dropouts Enrollment Dropout % 


Dropouts Enrollment Dropout % 


Murchison lo 109 9% 
Travis 20 58 34% 
Johnston 4 17 24% 
Anderson 0 9 "0% 


4 40 10% 

5 17 29% 

5 21 24% 

6 24 25% 


14 149 9% 
25 75 33% 
9 38 24% 
6 33 18% 


lOTAL 34 193 18% 


20 102 20% 


54 295 18% 


Grade 






7 3 42 7% 

8 7 67 10% 

9 17 ■ 45 38% . 

10 6 27 22% 

11 1 12 8% 

12 0 0 0% 


2 17 12% 
Z 23 9% 
13 37 35% 
2 14 14% 
1 11 9% 
0 0 0% 


5 59 8% 
9 90 10% 
30 82 37% 
8 41 20% 
2 23 9% 
0 0 0% 


I'ufAL 34 193 18^ 


20 102 20% 


b4 295 18% 
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